Nov 02 10:33:39 devstack cinder-volume[75847]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 10:33:39 devstack cinder-volume[75847]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 10:33:39 devstack cinder-volume[75847]: we strongly recommend against using it for new projects. Nov 02 10:33:39 devstack cinder-volume[75847]: If you are already using Eventlet, we recommend migrating to a different Nov 02 10:33:39 devstack cinder-volume[75847]: framework. For more detail see Nov 02 10:33:39 devstack cinder-volume[75847]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 10:33:39 devstack cinder-volume[75847]: import eventlet # noqa Nov 02 10:33:42 devstack cinder-volume[75847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75847) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:33:42 devstack cinder-volume[75847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75847) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:33:42 devstack cinder-volume[75847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75847) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:33:43 devstack cinder-volume[75847]: INFO dbcounter [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Registered counter for database cinder Nov 02 10:33:43 devstack cinder-volume[75847]: DEBUG oslo_db.sqlalchemy.engines [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75847) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:33:43 devstack cinder-volume[75847]: DEBUG dbcounter [-] [75847] Writer thread running {{(pid=75847) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:33:43 devstack cinder-volume[75847]: INFO cinder.rpc [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 10:33:43 devstack cinder-volume[75847]: INFO cinder.rpc [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 10:33:43 devstack cinder-volume[75847]: DEBUG oslo_db.sqlalchemy.engines [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75847) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:33:43 devstack cinder-volume[75847]: INFO cinder.volume.manager [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Determined volume DB was empty at startup. Nov 02 10:33:43 devstack cinder-volume[75847]: DEBUG cinder.volume.manager [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75847) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 10:33:43 devstack cinder-volume[75847]: INFO cinder.volume.manager [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 10:33:43 devstack cinder-volume[75847]: WARNING stevedore.named [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 10:33:43 devstack cinder-volume[75847]: WARNING castellan.key_manager [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:33:43 devstack cinder-volume[75847]: WARNING cinder.keymgr.conf_key_mgr [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:33:43 devstack cinder-volume[75847]: DEBUG cinder.volume.drivers.lvm [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75847) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 02 10:33:43 devstack cinder-volume[75847]: DEBUG oslo_concurrency.processutils [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75847) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_concurrency.processutils [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] CMD "cinder-rtstool verify" returned: 0 in 0.396s {{(pid=75847) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_db.sqlalchemy.engines [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75847) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:33:44 devstack cinder-volume[75847]: INFO cinder.rpc [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 02 10:33:44 devstack cinder-volume[75847]: INFO cinder.rpc [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 02 10:33:44 devstack cinder-volume[75847]: WARNING stevedore.named [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 10:33:44 devstack cinder-volume[75847]: WARNING castellan.key_manager [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:33:44 devstack cinder-volume[75847]: INFO cinder.volume.manager [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_db.sqlalchemy.engines [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75847) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:33:44 devstack cinder-volume[75847]: INFO oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Starting 1 workers Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Started child 76145 {{(pid=75847) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Full set of CONF: {{(pid=75847) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] ******************************************************************************** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Configuration options gathered from: {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] ================================================================================ {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] allow_availability_zone_fallback = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] allow_compression_on_image_upload = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] allowed_direct_url_schemes = [] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] api_rate_limit = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] auth_strategy = keystone {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] az_cache_duration = 3600 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_availability_zone = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_host = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_name = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_stats_polling_interval = 60 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backup_api_class = cinder.backup.api.API {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backup_name_template = backup-%s {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backup_use_same_host = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backup_use_temp_snapshot = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] chap_password = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] chap_username = {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cinder_internal_tenant_project_id = c1dcfab38ade4ffe83a889d9106cd9a6 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cinder_internal_tenant_user_id = d5d3bbf087424a118bfa157538ffebae {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cloned_volume_same_az = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cluster = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] compression_format = gzip {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] compute_api_class = cinder.compute.nova.API {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] config_dir = [] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] config_source = [] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] control_exchange = openstack {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[76145]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] debug = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] default_availability_zone = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] default_group_type = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] default_volume_type = lvmdriver-1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] disk_geometry = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] driver_client_cert = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] driver_client_cert_key = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] driver_data_namespace = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] driver_ssl_cert_path = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] driver_ssl_cert_verify = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] driver_use_ssl = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] enable_force_upload = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] enable_new_services = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] enable_unsupported_driver = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] enabled_backends = ['lvmdriver-1'] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] enforce_multipath_for_image_xfer = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] filter_function = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance_api_insecure = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance_api_servers = ['http://192.168.122.2/image'] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance_api_ssl_compression = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance_ca_certificates_file = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance_catalog_info = image:glance:publicURL {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance_certfile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance_keyfile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance_num_retries = 3 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance_request_timeout = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] goodness_function = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] graceful_shutdown_timeout = 5 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] group_api_class = cinder.group.api.API {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] host = devstack {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] image_compress_on_upload = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] image_conversion_address_space_limit = 1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] image_conversion_cpu_limit = 60 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] image_conversion_disable = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] image_introspection_address_space_limit = 1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] image_introspection_cpu_limit = 60 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] image_upload_use_cinder_backend = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] image_upload_use_internal_tenant = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] image_volume_cache_enabled = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] image_volume_cache_max_count = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] image_volume_cache_max_size_gb = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] init_host_max_objects_retrieval = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] instance_format = [instance: %(uuid)s] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] iscsi_target_flags = {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] iscsi_write_cache = on {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] iser_helper = tgtadm {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] iser_ip_address = 192.168.122.2 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] iser_port = 3260 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] log_color = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] log_config_append = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] log_dir = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] log_file = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] log_options = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[76145]: INFO cinder.volume.manager [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 02 10:33:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] log_rotate_interval = 1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] log_rotate_interval_type = days {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] log_rotation_type = none {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] max_age = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] max_logfile_count = 30 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] max_logfile_size_mb = 200 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] max_over_subscription_ratio = 20.0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] message_reap_interval = 86400 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] message_ttl = 2592000 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] migration_create_volume_timeout_secs = 300 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] monkey_patch = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] monkey_patch_modules = [] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] my_ip = 192.168.122.2 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] no_snapshot_gb_quota = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] num_iser_scan_tries = 3 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] num_shell_tries = 3 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] num_volume_device_scan_tries = 3 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] nvmeof_conn_info_version = 1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] nvmet_ns_id = 10 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] nvmet_port_id = 1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] osapi_max_limit = 1000 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] osapi_volume_ext_list = [] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] osapi_volume_listen = 0.0.0.0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] osapi_volume_listen_port = 8776 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] osapi_volume_use_ssl = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] osapi_volume_workers = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] per_volume_size_limit = -1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] periodic_fuzzy_delay = 60 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] periodic_interval = 60 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] project_id_regex = [0-9a-f\-]+ {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] public_endpoint = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] publish_errors = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] quota_backup_gigabytes = 1000 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] quota_backups = 10 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] quota_gigabytes = 1000 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] quota_groups = 10 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] quota_snapshots = 10 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] quota_volumes = 10 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] rate_limit_burst = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] rate_limit_except_level = CRITICAL {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] rate_limit_interval = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] reinit_driver_count = 3 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] replication_device = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] report_discard_supported = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] report_interval = 120 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] reservation_clean_interval = 86400 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] reservation_expire = 86400 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] reserved_image_namespaces = [] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] reserved_percentage = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] rpc_response_timeout = 120 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] run_external_periodic_tasks = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] scst_target_driver = iscsi {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] scst_target_iqn_name = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] service_down_time = 720 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] shell_completion = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] snapshot_name_template = snapshot-%s {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] snapshot_same_host = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] split_loggers = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] state_path = /opt/stack/data/cinder {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] storage_availability_zone = nova {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] storage_protocol = iSCSI {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] syslog_log_facility = LOG_USER {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] target_helper = lioadm {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] target_ip_address = 192.168.122.2 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] target_port = 3260 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] target_protocol = iscsi {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] target_secondary_ip_addresses = [] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] trace_flags = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] transfer_api_class = cinder.transfer.api.API {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] transport_url = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] until_refresh = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] use_chap_auth = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] use_default_quota_class = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] use_journal = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] use_json = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] use_multipath_for_image_xfer = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] use_stderr = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] use_syslog = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] verify_glance_signatures = enabled {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] volume_api_class = cinder.volume.api.API {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] volume_backend_name = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] volume_clear = zero {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] volume_clear_ionice = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] volume_clear_size = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] volume_copy_bps_limit = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] volume_dd_blocksize = 1M {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] volume_name_template = volume-%s {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] volume_service_inithost_offload = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] volume_usage_audit_period = month {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] zoning_mode = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_concurrency.disable_process_locking = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.auth_section = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.auth_type = password {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.auth_version = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.cache = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.certfile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.delay_auth_decision = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.http_connect_timeout = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.include_service_catalog = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.insecure = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.interface = public {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.keyfile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.memcache_password = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.memcache_username = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.region_name = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.service_token_roles_required = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.service_type = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.token_cache_time = 300 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.2/identity {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.backend = dogpile.cache.null {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.backend_argument = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.backend_expiration_time = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.config_prefix = cache.oslo {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.debug_cache_backend = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.enable_retry_client = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.enable_socket_keepalive = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.enabled = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.expiration_time = 600 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.hashclient_retry_attempts = 2 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.memcache_dead_retry = 300 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.memcache_pool_maxsize = 10 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.memcache_sasl_enabled = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack sudo[76189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.password = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.proxies = [] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.redis_db = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.redis_sentinel_service_name = mymaster {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack sudo[76189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.redis_server = localhost:6379 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.retry_attempts = 2 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.retry_delay = 0.0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.socket_keepalive_count = 1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.socket_keepalive_idle = 1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.socket_keepalive_interval = 1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.socket_timeout = 1.0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.tls_allowed_ciphers = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.tls_cafile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.tls_certfile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.tls_enabled = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.tls_keyfile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cache.username = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] coordination.backend_url = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.asyncio_connection = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.asyncio_slave_connection = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.backend = sqlalchemy {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.connection = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.connection_debug = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.connection_parameters = {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.connection_recycle_time = 3600 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.connection_trace = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.db_inc_retry_interval = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.db_max_retries = 20 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.db_max_retry_interval = 10 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.db_retry_interval = 1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.max_overflow = 50 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.max_pool_size = 5 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.max_retries = 10 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.mysql_wsrep_sync_wait = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.pool_timeout = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.retry_interval = 10 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.slave_connection = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.sqlite_synchronous = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.synchronous_reader = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] database.use_db_reconnect = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_tracing.insecure = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] profiler.connection_string = messaging:// {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] profiler.enabled = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] profiler.es_doc_type = notification {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] profiler.es_scroll_size = 10000 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] profiler.es_scroll_time = 2m {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] profiler.filter_error_trace = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] profiler.hmac_keys = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] profiler.sentinel_service_name = mymaster {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] profiler.socket_timeout = 0.1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] profiler.trace_requests = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] profiler.trace_sqlalchemy = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] profiler_jaeger.process_tags = {} {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] profiler_jaeger.service_name_prefix = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] profiler_otlp.service_name_prefix = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_policy.enforce_new_defaults = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_policy.policy_default_rule = default {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_policy.policy_file = policy.yaml {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_policy.remote_timeout = 60.0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] privsep_osbrick.group = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] privsep_osbrick.helper_command = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] privsep_osbrick.user = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cinder_sys_admin.group = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cinder_sys_admin.helper_command = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] cinder_sys_admin.user = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] service_user.auth_section = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] service_user.auth_type = password {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] service_user.cafile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] service_user.certfile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] service_user.collect_timing = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] service_user.insecure = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] service_user.keyfile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] service_user.send_service_user_token = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] service_user.split_loggers = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] service_user.timeout = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] service_user.tls_ciphers = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] service_user.tls_min_version = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance.auth_section = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance.auth_type = password {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance.certfile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance.collect_timing = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance.insecure = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance.keyfile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance.region_name = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance.split_loggers = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance.timeout = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance.tls_ciphers = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] glance.tls_min_version = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.backend_availability_zone = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.chap_password = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.chap_username = {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.disk_geometry = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.driver_client_cert = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.driver_client_cert_key = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.driver_data_namespace = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.driver_use_ssl = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.enable_unsupported_driver = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.extra_capabilities = {} {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.filter_function = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.goodness_function = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.iscsi_target_flags = {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.iscsi_write_cache = on {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.iser_helper = tgtadm {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.iser_ip_address = 192.168.122.2 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.iser_port = 3260 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.lvm_mirrors = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.lvm_share_target = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.lvm_type = auto {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.num_shell_tries = 3 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.nvmet_port_id = 1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.replication_device = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.report_discard_supported = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.reserved_percentage = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.scst_target_driver = iscsi {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.scst_target_iqn_name = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.storage_protocol = iSCSI {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.target_helper = tgtadm {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.target_ip_address = 192.168.122.2 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.target_port = 3260 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.target_protocol = iscsi {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.trace_flags = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.unique_fqdn_network = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.use_chap_auth = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.volume_backend_name = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.volume_clear = zero {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.volume_clear_ionice = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.volume_clear_size = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.volume_group = cinder-volumes {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_reports.file_event_handler = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_reports.log_dir = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.backend_availability_zone = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.backend_host = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.chap_password = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.chap_username = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.chiscsi_conf = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.disk_geometry = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.driver_client_cert = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.driver_data_namespace = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.driver_use_ssl = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.extra_capabilities = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.filter_function = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.goodness_function = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.iser_helper = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.iser_ip_address = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.iser_port = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.iser_target_prefix = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.lvm_conf_file = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.lvm_mirrors = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.lvm_share_target = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.lvm_type = auto {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.num_shell_tries = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.nvmet_port_id = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.replication_device = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.report_discard_supported = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.reserved_percentage = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.scst_target_driver = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.storage_protocol = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.target_helper = lioadm {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.target_ip_address = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.target_port = 3260 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.target_protocol = iscsi {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.trace_flags = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.use_chap_auth = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.volume_clear = zero {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.volume_clear_size = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] lvmdriver-1.volumes_dir = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.ssl = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.ssl_version = {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_notifications.driver = [] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_notifications.retry = -1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] oslo_messaging_notifications.transport_url = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] key_manager.fixed_key = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican.barbican_api_version = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican.barbican_endpoint = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican.barbican_endpoint_type = public {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican.barbican_region_name = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican.cafile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican.certfile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican.collect_timing = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican.insecure = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican.keyfile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican.number_of_retries = 60 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican.retry_delay = 1 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican.send_service_user_token = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican.split_loggers = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican.timeout = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican.tls_ciphers = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican.tls_min_version = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican.verify_ssl = True {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican.verify_ssl_path = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican_service_user.auth_section = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican_service_user.auth_type = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican_service_user.cafile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican_service_user.certfile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican_service_user.collect_timing = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican_service_user.insecure = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican_service_user.keyfile = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican_service_user.split_loggers = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican_service_user.timeout = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican_service_user.tls_ciphers = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] barbican_service_user.tls_min_version = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] vault.approle_role_id = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] vault.approle_secret_id = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] vault.auth_method = approle {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] vault.auth_path = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] vault.kv_mountpoint = secret {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] vault.kv_path = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] vault.kv_version = 2 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] vault.namespace = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] vault.root_token_id = **** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] vault.ssl_ca_crt_file = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] vault.timeout = 60.0 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] vault.token_file = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] vault.token_role = None {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] vault.use_ssl = False {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:33:44 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] ******************************************************************************** {{(pid=75847) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 10:33:45 devstack sudo[76189]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:45 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:45 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:45 devstack sudo[76306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:33:45 devstack sudo[76306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:45 devstack sudo[76306]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:45 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.253s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:45 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:33:45 devstack cinder-volume[76145]: INFO cinder.brick.local_dev.lvm [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 02 10:33:45 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:45 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:45 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:45 devstack sudo[76399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:33:45 devstack sudo[76399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:45 devstack sudo[76399]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:45 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:45 devstack cinder-volume[76145]: DEBUG cinder.brick.local_dev.lvm [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76145) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 02 10:33:45 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:45 devstack sudo[76480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:33:45 devstack sudo[76480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:46 devstack sudo[76480]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:46 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.354s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:46 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:46 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:46 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:46 devstack sudo[76712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:33:46 devstack sudo[76712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:47 devstack sudo[76712]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:47 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.309s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:47 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:47 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:47 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:47 devstack sudo[76767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 02 10:33:47 devstack sudo[76767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:47 devstack sudo[76767]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:47 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.299s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:47 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:47 devstack sudo[76770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:33:47 devstack sudo[76770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:47 devstack sudo[76770]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:47 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:47 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:47 devstack sudo[76773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:33:47 devstack sudo[76773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:48 devstack sudo[76773]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:48 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:48 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:48 devstack sudo[76776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:33:48 devstack sudo[76776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:48 devstack sudo[76776]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:48 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:48 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:48 devstack sudo[76785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:33:48 devstack sudo[76785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:48 devstack sudo[76785]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:48 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:48 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:48 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:48 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:48 devstack sudo[76789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:33:48 devstack sudo[76789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:49 devstack sudo[76789]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:49 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:49 devstack cinder-volume[76145]: INFO cinder.volume.drivers.lvm [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 02 10:33:49 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:49 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:49 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:49 devstack sudo[76794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:33:49 devstack sudo[76794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:49 devstack sudo[76794]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:49 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:49 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 10:33:49 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:49 devstack sudo[76799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:33:49 devstack sudo[76799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:49 devstack sudo[76799]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:49 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:49 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:49 devstack sudo[76802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:33:49 devstack sudo[76802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:49 devstack sudo[76802]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:49 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:49 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:49 devstack sudo[76805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:33:49 devstack sudo[76805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:50 devstack sudo[76805]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:50 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:50 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:50 devstack sudo[76808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:33:50 devstack sudo[76808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:50 devstack sudo[76808]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:50 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:50 devstack cinder-volume[76145]: INFO cinder.volume.driver [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Driver hasn't implemented _init_vendor_properties() Nov 02 10:33:50 devstack cinder-volume[76145]: DEBUG cinder.volume.driver [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76145) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 10:33:50 devstack cinder-volume[76145]: DEBUG oslo_db.sqlalchemy.engines [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76145) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:33:50 devstack cinder-volume[76145]: DEBUG dbcounter [-] [76145] Writer thread running {{(pid=76145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:33:50 devstack cinder-volume[76145]: DEBUG cinder.db.api [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Building query based on filter {{(pid=76145) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 10:33:50 devstack cinder-volume[76145]: DEBUG cinder.image.image_utils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76145) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 10:33:50 devstack cinder-volume[76145]: INFO cinder.keymgr.migration [None req-30cdfa4d-a04d-4f4a-80bd-bcaced655919 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 10:33:50 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 10:33:50 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:50 devstack sudo[76813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:33:50 devstack sudo[76813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:50 devstack sudo[76813]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:50 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:50 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:50 devstack sudo[76816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:33:50 devstack sudo[76816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:51 devstack sudo[76816]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:51 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:51 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:51 devstack sudo[76823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:33:51 devstack sudo[76823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:51 devstack sudo[76823]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:51 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:51 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:51 devstack sudo[76829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:33:51 devstack sudo[76829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:51 devstack sudo[76829]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:51 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:51 devstack cinder-volume[76145]: DEBUG cinder.manager [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Notifying Schedulers of capabilities ... {{(pid=76145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:33:51 devstack cinder-volume[76145]: INFO cinder.volume.manager [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Driver initialization completed successfully. Nov 02 10:33:51 devstack cinder-volume[76145]: INFO cinder.manager [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Initiating service 2 cleanup Nov 02 10:33:51 devstack cinder-volume[76145]: INFO cinder.manager [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Service 2 cleanup completed. Nov 02 10:33:51 devstack cinder-volume[76145]: DEBUG cinder.service [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Creating RPC server for service cinder-volume {{(pid=76145) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 10:33:51 devstack cinder-volume[76145]: DEBUG cinder.service [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76145) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 10:33:51 devstack cinder-volume[76145]: INFO cinder.volume.manager [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 02 10:33:51 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 10:33:51 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:51 devstack sudo[76835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:33:51 devstack sudo[76835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:52 devstack sudo[76835]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:52 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:52 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:52 devstack sudo[76839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:33:52 devstack sudo[76839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:52 devstack sudo[76839]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:52 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:52 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:52 devstack sudo[76846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:33:52 devstack sudo[76846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:52 devstack sudo[76846]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:52 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.422s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:52 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:33:52 devstack sudo[76861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:33:52 devstack sudo[76861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:33:53 devstack sudo[76861]: pam_unix(sudo:session): session closed for user root Nov 02 10:33:53 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:33:53 devstack cinder-volume[76145]: INFO cinder.volume.manager [None req-503f859e-93a9-4deb-9846-e247cc632bca None None] Driver post RPC initialization completed successfully. Nov 02 10:33:54 devstack cinder-volume[75847]: DEBUG dbcounter [-] [75847] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75847) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:33:57 devstack cinder-volume[76145]: DEBUG oslo_service.periodic_task [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running periodic task VolumeManager._thread_info {{(pid=76145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:33:57 devstack cinder-volume[76145]: DEBUG cinder.volume.manager [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] thread count: 6 {{(pid=76145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:33:57 devstack cinder-volume[76145]: DEBUG cinder.volume.manager [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] thread info: [<_MainThread(MainThread, started 131376803213440)>, , , , , ] {{(pid=76145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:34:03 devstack cinder-volume[76145]: DEBUG dbcounter [-] [76145] Writing DB stats cinder:SELECT=3 {{(pid=76145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:34:03 devstack cinder-volume[76145]: DEBUG dbcounter [-] [76145] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:34:57 devstack cinder-volume[76145]: DEBUG oslo_service.periodic_task [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:34:57 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 10:34:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:34:57 devstack sudo[78871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:34:57 devstack sudo[78871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:34:57 devstack sudo[78871]: pam_unix(sudo:session): session closed for user root Nov 02 10:34:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:34:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:34:57 devstack sudo[78904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:34:57 devstack sudo[78904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:34:57 devstack sudo[78904]: pam_unix(sudo:session): session closed for user root Nov 02 10:34:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:34:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:34:57 devstack sudo[78907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:34:57 devstack sudo[78907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:34:58 devstack sudo[78907]: pam_unix(sudo:session): session closed for user root Nov 02 10:34:58 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:34:58 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:34:58 devstack sudo[78945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:34:58 devstack sudo[78945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:34:58 devstack sudo[78945]: pam_unix(sudo:session): session closed for user root Nov 02 10:34:58 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:34:58 devstack cinder-volume[76145]: DEBUG cinder.manager [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Notifying Schedulers of capabilities ... {{(pid=76145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:34:58 devstack cinder-volume[76145]: DEBUG oslo_service.periodic_task [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running periodic task VolumeManager._thread_info {{(pid=76145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:34:58 devstack cinder-volume[76145]: DEBUG cinder.volume.manager [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] thread count: 6 {{(pid=76145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:34:58 devstack cinder-volume[76145]: DEBUG cinder.volume.manager [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] thread info: [<_MainThread(MainThread, started 131376803213440)>, , , , , ] {{(pid=76145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:35:57 devstack cinder-volume[76145]: DEBUG oslo_service.periodic_task [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:35:57 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 10:35:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:35:57 devstack sudo[82198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:35:57 devstack sudo[82198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:35:57 devstack sudo[82198]: pam_unix(sudo:session): session closed for user root Nov 02 10:35:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:35:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:35:57 devstack sudo[82204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:35:57 devstack sudo[82204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:35:57 devstack sudo[82204]: pam_unix(sudo:session): session closed for user root Nov 02 10:35:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:35:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:35:57 devstack sudo[82207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:35:57 devstack sudo[82207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:35:58 devstack sudo[82207]: pam_unix(sudo:session): session closed for user root Nov 02 10:35:58 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:35:58 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:35:58 devstack sudo[82210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:35:58 devstack sudo[82210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:35:58 devstack sudo[82210]: pam_unix(sudo:session): session closed for user root Nov 02 10:35:58 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:35:58 devstack cinder-volume[76145]: DEBUG cinder.manager [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Notifying Schedulers of capabilities ... {{(pid=76145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:36:03 devstack cinder-volume[76145]: DEBUG dbcounter [-] [76145] Writing DB stats cinder:SELECT=1 {{(pid=76145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:36:03 devstack cinder-volume[76145]: DEBUG dbcounter [-] [76145] Writing DB stats cinder:UPDATE=1 {{(pid=76145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:36:57 devstack cinder-volume[76145]: DEBUG oslo_service.periodic_task [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:36:57 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 10:36:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:36:57 devstack sudo[84340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:36:57 devstack sudo[84340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:36:57 devstack sudo[84340]: pam_unix(sudo:session): session closed for user root Nov 02 10:36:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:36:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:36:57 devstack sudo[84343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:36:57 devstack sudo[84343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:36:57 devstack sudo[84343]: pam_unix(sudo:session): session closed for user root Nov 02 10:36:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:36:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:36:57 devstack sudo[84362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:36:57 devstack sudo[84362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:36:58 devstack sudo[84362]: pam_unix(sudo:session): session closed for user root Nov 02 10:36:58 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:36:58 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:36:58 devstack sudo[84373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:36:58 devstack sudo[84373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:36:58 devstack sudo[84373]: pam_unix(sudo:session): session closed for user root Nov 02 10:36:58 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:36:58 devstack cinder-volume[76145]: DEBUG cinder.manager [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Notifying Schedulers of capabilities ... {{(pid=76145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:36:58 devstack cinder-volume[76145]: DEBUG oslo_service.periodic_task [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running periodic task VolumeManager._thread_info {{(pid=76145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:36:58 devstack cinder-volume[76145]: DEBUG cinder.volume.manager [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] thread count: 6 {{(pid=76145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:36:58 devstack cinder-volume[76145]: DEBUG cinder.volume.manager [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] thread info: [<_MainThread(MainThread, started 131376803213440)>, , , , , ] {{(pid=76145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:37:57 devstack cinder-volume[76145]: DEBUG oslo_service.periodic_task [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:37:57 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 10:37:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:57 devstack sudo[85493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:37:57 devstack sudo[85493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:57 devstack sudo[85493]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:57 devstack sudo[85496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:37:57 devstack sudo[85496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:57 devstack sudo[85496]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:57 devstack sudo[85515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:37:57 devstack sudo[85515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:58 devstack sudo[85515]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:58 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:58 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:37:58 devstack sudo[85525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:37:58 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:37:58 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root Nov 02 10:37:58 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:37:58 devstack cinder-volume[76145]: DEBUG cinder.manager [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Notifying Schedulers of capabilities ... {{(pid=76145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:37:58 devstack cinder-volume[76145]: DEBUG oslo_service.periodic_task [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] Running periodic task VolumeManager._thread_info {{(pid=76145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:37:58 devstack cinder-volume[76145]: DEBUG cinder.volume.manager [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] thread count: 6 {{(pid=76145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:37:58 devstack cinder-volume[76145]: DEBUG cinder.volume.manager [None req-6c5117a5-4303-47c5-8f41-585383db340b None None] thread info: [<_MainThread(MainThread, started 131376803213440)>, , , , , ] {{(pid=76145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:38:03 devstack cinder-volume[76145]: DEBUG dbcounter [-] [76145] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:38:17 devstack cinder-volume[75847]: INFO oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Caught SIGTERM, stopping children Nov 02 10:38:17 devstack cinder-volume[75847]: DEBUG oslo_concurrency.lockutils [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Acquiring lock "singleton_lock" {{(pid=75847) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:38:17 devstack cinder-volume[75847]: DEBUG oslo_concurrency.lockutils [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Acquired lock "singleton_lock" {{(pid=75847) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:38:17 devstack cinder-volume[75847]: DEBUG oslo_concurrency.lockutils [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Releasing lock "singleton_lock" {{(pid=75847) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:38:17 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Stop services. {{(pid=75847) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 10:38:17 devstack cinder-volume[75847]: DEBUG oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Killing children. {{(pid=75847) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 10:38:17 devstack cinder-volume[75847]: INFO oslo_service.backend._eventlet.service [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Waiting on 1 children to exit Nov 02 10:38:22 devstack cinder-volume[76145]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Nov 02 10:38:22 devstack cinder-volume[86052]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 10:38:22 devstack cinder-volume[86052]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 10:38:22 devstack cinder-volume[86052]: we strongly recommend against using it for new projects. Nov 02 10:38:22 devstack cinder-volume[86052]: If you are already using Eventlet, we recommend migrating to a different Nov 02 10:38:22 devstack cinder-volume[86052]: framework. For more detail see Nov 02 10:38:22 devstack cinder-volume[86052]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 10:38:22 devstack cinder-volume[86052]: import eventlet # noqa Nov 02 10:38:24 devstack cinder-volume[86052]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:38:24 devstack cinder-volume[86052]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:38:24 devstack cinder-volume[86052]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:38:25 devstack cinder-volume[86052]: INFO dbcounter [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Registered counter for database cinder Nov 02 10:38:25 devstack cinder-volume[86052]: DEBUG oslo_db.sqlalchemy.engines [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86052) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:38:25 devstack cinder-volume[86052]: DEBUG dbcounter [-] [86052] Writer thread running {{(pid=86052) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:38:25 devstack cinder-volume[86052]: INFO cinder.rpc [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 10:38:25 devstack cinder-volume[86052]: INFO cinder.rpc [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_db.sqlalchemy.engines [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86052) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:38:26 devstack cinder-volume[86052]: INFO cinder.volume.manager [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Determined volume DB was empty at startup. Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG cinder.volume.manager [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86052) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 10:38:26 devstack cinder-volume[86052]: INFO cinder.volume.manager [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 10:38:26 devstack cinder-volume[86052]: WARNING stevedore.named [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 10:38:26 devstack cinder-volume[86052]: WARNING castellan.key_manager [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:38:26 devstack cinder-volume[86052]: WARNING cinder.keymgr.conf_key_mgr [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:38:26 devstack cinder-volume[86052]: INFO cinder.volume.manager [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_db.sqlalchemy.engines [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86052) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:38:26 devstack cinder-volume[86052]: INFO oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Starting 1 workers Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Started child 86274 {{(pid=86052) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Full set of CONF: {{(pid=86052) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] ******************************************************************************** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Configuration options gathered from: {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] ================================================================================ {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] allow_availability_zone_fallback = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] allow_compression_on_image_upload = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] allowed_direct_url_schemes = [] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] api_rate_limit = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] auth_strategy = keystone {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_availability_zone = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_host = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_name = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_stats_polling_interval = 60 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backup_api_class = cinder.backup.api.API {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backup_name_template = backup-%s {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backup_use_same_host = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backup_use_temp_snapshot = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] chap_password = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] chap_username = {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cinder_internal_tenant_project_id = c1dcfab38ade4ffe83a889d9106cd9a6 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cinder_internal_tenant_user_id = d5d3bbf087424a118bfa157538ffebae {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86274]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cluster = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] compression_format = gzip {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] compute_api_class = cinder.compute.nova.API {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] config_dir = [] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] config_source = [] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] control_exchange = openstack {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] debug = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] default_availability_zone = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] default_group_type = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] default_volume_type = QuobyteHD {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] disk_geometry = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] driver_client_cert = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] driver_client_cert_key = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] driver_data_namespace = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] driver_ssl_cert_path = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] driver_ssl_cert_verify = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] driver_use_ssl = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] enable_new_services = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] enable_unsupported_driver = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] enabled_backends = ['QuobyteHD'] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] enforce_multipath_for_image_xfer = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] filter_function = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance_api_insecure = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance_api_servers = ['http://192.168.122.2/image'] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance_api_ssl_compression = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance_ca_certificates_file = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance_catalog_info = image:glance:publicURL {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance_certfile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance_keyfile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance_num_retries = 3 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance_request_timeout = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] goodness_function = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] graceful_shutdown_timeout = 5 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] group_api_class = cinder.group.api.API {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] host = devstack {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] image_compress_on_upload = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] image_conversion_address_space_limit = 1 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] image_conversion_cpu_limit = 60 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] image_conversion_disable = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] image_introspection_address_space_limit = 1 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] image_introspection_cpu_limit = 60 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] image_upload_use_cinder_backend = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] image_upload_use_internal_tenant = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] image_volume_cache_enabled = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] image_volume_cache_max_count = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] image_volume_cache_max_size_gb = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] init_host_max_objects_retrieval = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] instance_format = [instance: %(uuid)s] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] iscsi_target_flags = {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] iscsi_write_cache = on {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] iser_helper = tgtadm {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] iser_ip_address = 192.168.122.2 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] iser_port = 3260 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] log_color = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] log_config_append = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] log_dir = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] log_file = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] log_options = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] log_rotate_interval = 1 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] log_rotate_interval_type = days {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] log_rotation_type = none {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] max_age = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] max_logfile_count = 30 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] max_logfile_size_mb = 200 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] max_over_subscription_ratio = 20.0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] message_reap_interval = 86400 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] message_ttl = 2592000 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] migration_create_volume_timeout_secs = 300 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] monkey_patch = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] monkey_patch_modules = [] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] my_ip = 192.168.122.2 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] no_snapshot_gb_quota = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] num_iser_scan_tries = 3 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] num_shell_tries = 3 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] num_volume_device_scan_tries = 3 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] nvmeof_conn_info_version = 1 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] nvmet_ns_id = 10 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] nvmet_port_id = 1 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] osapi_max_limit = 1000 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] osapi_volume_ext_list = [] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] osapi_volume_listen = 0.0.0.0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] osapi_volume_listen_port = 8776 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] osapi_volume_use_ssl = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] osapi_volume_workers = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] per_volume_size_limit = -1 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] periodic_fuzzy_delay = 60 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] periodic_interval = 60 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] project_id_regex = [0-9a-f\-]+ {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] public_endpoint = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] publish_errors = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] quota_backup_gigabytes = 1000 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] quota_backups = 10 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86274]: INFO cinder.volume.manager [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] quota_gigabytes = 1000 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] quota_groups = 10 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] quota_snapshots = 10 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86274]: DEBUG cinder.volume.drivers.remotefs [None req-0661161f-4727-40e5-838d-41a93028e051 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86274) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] quota_volumes = 10 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] rate_limit_burst = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] rate_limit_except_level = CRITICAL {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] rate_limit_interval = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] reinit_driver_count = 3 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] replication_device = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] report_discard_supported = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] report_interval = 120 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] reservation_clean_interval = 86400 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] reservation_expire = 86400 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] reserved_image_namespaces = [] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] reserved_percentage = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] rpc_response_timeout = 120 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] run_external_periodic_tasks = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] scst_target_driver = iscsi {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] scst_target_iqn_name = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] service_down_time = 720 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] shell_completion = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] snapshot_name_template = snapshot-%s {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] split_loggers = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] state_path = /opt/stack/data/cinder {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] storage_availability_zone = nova {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] storage_protocol = iSCSI {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] syslog_log_facility = LOG_USER {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] target_helper = lioadm {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] target_ip_address = 192.168.122.2 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] target_port = 3260 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] target_protocol = iscsi {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] target_secondary_ip_addresses = [] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] trace_flags = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] transfer_api_class = cinder.transfer.api.API {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] transport_url = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] until_refresh = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] use_chap_auth = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] use_default_quota_class = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] use_journal = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] use_json = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] use_multipath_for_image_xfer = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] use_stderr = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] use_syslog = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] verify_glance_signatures = enabled {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] volume_api_class = cinder.volume.api.API {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] volume_backend_name = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] volume_clear = zero {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] volume_clear_ionice = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] volume_clear_size = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] volume_copy_bps_limit = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] volume_dd_blocksize = 1M {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] volume_name_template = volume-%s {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] volume_service_inithost_offload = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] volume_usage_audit_period = month {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] zoning_mode = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_concurrency.disable_process_locking = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.auth_section = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.auth_type = password {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.auth_version = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.cache = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.certfile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.delay_auth_decision = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.http_connect_timeout = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.include_service_catalog = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.insecure = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.interface = public {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.keyfile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.memcache_password = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.memcache_username = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.region_name = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.service_token_roles_required = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.service_type = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.token_cache_time = 300 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.2/identity {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.backend = dogpile.cache.null {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.backend_argument = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.backend_expiration_time = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.config_prefix = cache.oslo {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.debug_cache_backend = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.enable_retry_client = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.enable_socket_keepalive = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.enabled = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.expiration_time = 600 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.hashclient_retry_attempts = 2 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.memcache_dead_retry = 300 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.memcache_pool_maxsize = 10 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.memcache_sasl_enabled = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.password = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.proxies = [] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.redis_db = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.redis_sentinel_service_name = mymaster {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.redis_server = localhost:6379 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.retry_attempts = 2 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.retry_delay = 0.0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.socket_keepalive_count = 1 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.socket_keepalive_idle = 1 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.socket_keepalive_interval = 1 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.socket_timeout = 1.0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.tls_allowed_ciphers = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.tls_cafile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.tls_certfile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.tls_enabled = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.tls_keyfile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cache.username = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] coordination.backend_url = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86274]: DEBUG cinder.volume.drivers.quobyte [None req-0661161f-4727-40e5-838d-41a93028e051 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86274) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 10:38:26 devstack cinder-volume[86274]: WARNING cinder.volume.drivers.quobyte [None req-0661161f-4727-40e5-838d-41a93028e051 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 10:38:26 devstack cinder-volume[86274]: WARNING cinder.volume.drivers.quobyte [None req-0661161f-4727-40e5-838d-41a93028e051 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.asyncio_connection = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.asyncio_slave_connection = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.backend = sqlalchemy {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.connection = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.connection_debug = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.connection_parameters = {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.connection_recycle_time = 3600 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.connection_trace = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.db_inc_retry_interval = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.db_max_retries = 20 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.db_max_retry_interval = 10 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.db_retry_interval = 1 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.max_overflow = 50 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.max_pool_size = 5 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Running cmd (subprocess): mount.quobyte {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.max_retries = 10 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.mysql_wsrep_sync_wait = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.pool_timeout = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.retry_interval = 10 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.slave_connection = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.sqlite_synchronous = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.synchronous_reader = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] database.use_db_reconnect = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_tracing.insecure = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] profiler.connection_string = messaging:// {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] profiler.enabled = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] profiler.es_doc_type = notification {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] profiler.es_scroll_size = 10000 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] profiler.es_scroll_time = 2m {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] profiler.filter_error_trace = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] profiler.hmac_keys = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] profiler.sentinel_service_name = mymaster {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] profiler.socket_timeout = 0.1 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] profiler.trace_requests = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] profiler.trace_sqlalchemy = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] profiler_jaeger.process_tags = {} {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] profiler_jaeger.service_name_prefix = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] profiler_otlp.service_name_prefix = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_policy.enforce_new_defaults = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_policy.policy_default_rule = default {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_policy.policy_file = policy.yaml {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_policy.remote_timeout = 60.0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] privsep_osbrick.group = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] privsep_osbrick.helper_command = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] privsep_osbrick.user = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cinder_sys_admin.group = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cinder_sys_admin.helper_command = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] cinder_sys_admin.user = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] service_user.auth_section = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] service_user.auth_type = password {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] service_user.cafile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] service_user.certfile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] service_user.collect_timing = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] service_user.insecure = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] service_user.keyfile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] service_user.send_service_user_token = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] service_user.split_loggers = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] service_user.timeout = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] service_user.tls_ciphers = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] service_user.tls_min_version = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance.auth_section = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance.auth_type = password {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance.certfile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance.collect_timing = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance.insecure = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance.keyfile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance.region_name = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance.split_loggers = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance.timeout = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance.tls_ciphers = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] glance.tls_min_version = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.backend_availability_zone = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.chap_password = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.chap_username = {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.disk_geometry = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.driver_client_cert = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.driver_client_cert_key = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.driver_data_namespace = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.driver_use_ssl = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.enable_unsupported_driver = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.extra_capabilities = {} {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.filter_function = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.goodness_function = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.iscsi_target_flags = {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.iscsi_write_cache = on {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.iser_helper = tgtadm {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.iser_ip_address = 192.168.122.2 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.iser_port = 3260 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.nas_host = {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.nas_login = admin {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.nas_mount_options = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.nas_password = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.nas_private_key = {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.nas_share_path = {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.nas_ssh_port = 22 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.num_shell_tries = 3 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.nvmet_port_id = 1 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.quobyte_client_cfg = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.quobyte_volume_url = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.replication_device = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.report_discard_supported = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.reserved_percentage = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.scst_target_driver = iscsi {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.scst_target_iqn_name = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.storage_protocol = iSCSI {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.target_helper = tgtadm {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.target_ip_address = 192.168.122.2 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.target_port = 3260 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.target_protocol = iscsi {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.trace_flags = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.unique_fqdn_network = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.use_chap_auth = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.volume_backend_name = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.volume_clear = zero {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.volume_clear_ionice = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.volume_clear_size = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_reports.file_event_handler = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_reports.log_dir = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.backend_availability_zone = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.backend_host = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.chap_password = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.chap_username = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.chiscsi_conf = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.disk_geometry = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.driver_client_cert = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.driver_client_cert_key = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.driver_data_namespace = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.driver_use_ssl = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.extra_capabilities = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.filter_function = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.goodness_function = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.iscsi_target_flags = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.iscsi_write_cache = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.iser_helper = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.iser_ip_address = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.iser_port = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.iser_target_prefix = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.nas_host = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.nas_login = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.nas_mount_options = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.nas_password = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.nas_private_key = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.nas_share_path = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.nas_ssh_port = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.num_shell_tries = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.nvmet_ns_id = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.nvmet_port_id = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.replication_device = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.report_discard_supported = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.reserved_percentage = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.scst_target_driver = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.storage_protocol = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.target_helper = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.target_ip_address = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.target_port = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.target_prefix = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.target_protocol = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.trace_flags = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.unique_fqdn_network = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.use_chap_auth = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.volume_clear = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.volume_clear_ionice = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.volume_clear_size = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] QuobyteHD.volumes_dir = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.ssl = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.ssl_version = {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_notifications.driver = [] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_notifications.retry = -1 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] oslo_messaging_notifications.transport_url = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] key_manager.fixed_key = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican.barbican_api_version = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican.barbican_endpoint = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican.barbican_endpoint_type = public {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican.barbican_region_name = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican.cafile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican.certfile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican.collect_timing = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican.insecure = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican.keyfile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican.number_of_retries = 60 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican.retry_delay = 1 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican.send_service_user_token = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican.split_loggers = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican.timeout = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican.tls_ciphers = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican.tls_min_version = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican.verify_ssl = True {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican.verify_ssl_path = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican_service_user.auth_section = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican_service_user.auth_type = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican_service_user.cafile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican_service_user.certfile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican_service_user.collect_timing = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican_service_user.insecure = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican_service_user.keyfile = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican_service_user.split_loggers = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican_service_user.timeout = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican_service_user.tls_ciphers = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] barbican_service_user.tls_min_version = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] vault.approle_role_id = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] vault.approle_secret_id = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] vault.auth_method = approle {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] vault.auth_path = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] vault.kv_mountpoint = secret {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] vault.kv_path = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] vault.kv_version = 2 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] vault.namespace = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] vault.root_token_id = **** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] vault.ssl_ca_crt_file = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] vault.timeout = 60.0 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] vault.token_file = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] vault.token_role = None {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] vault.use_ssl = False {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:26 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] ******************************************************************************** {{(pid=86052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 10:38:26 devstack quobyte-client[86279]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 10:38:26 devstack quobyte-client[86279]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 10:38:26 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-0661161f-4727-40e5-838d-41a93028e051 None None] CMD "mount.quobyte" returned: 1 in 0.146s {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:26 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:26 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:26 devstack cinder-volume[86274]: DEBUG cinder.volume.drivers.quobyte [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=86274) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:26 devstack cinder-volume[86274]: INFO cinder.volume.drivers.quobyte [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 ... Nov 02 10:38:26 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd -c /etc/quobyte/client-cinder.cfg {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:26 devstack sudo[86281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd -c /etc/quobyte/client-cinder.cfg Nov 02 10:38:26 devstack sudo[86281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:26 devstack cinder-volume[76145]: DEBUG oslo_concurrency.lockutils [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Acquiring lock "singleton_lock" {{(pid=76145) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:38:26 devstack cinder-volume[76145]: DEBUG oslo_concurrency.lockutils [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Acquired lock "singleton_lock" {{(pid=76145) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:38:26 devstack cinder-volume[76145]: DEBUG oslo_concurrency.lockutils [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Releasing lock "singleton_lock" {{(pid=76145) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:38:26 devstack cinder-volume[76145]: WARNING amqp [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 10:38:26 devstack cinder-volume[76145]: WARNING amqp [None req-13349c4d-ae98-4d9c-8140-e07d547d4f5c None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 10:38:27 devstack sudo[86281]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-0661161f-4727-40e5-838d-41a93028e051 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.409s {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:27 devstack cinder-volume[86274]: INFO cinder.volume.drivers.quobyte [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 succeeded Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG cinder.volume.drivers.quobyte [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=86274) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.423s {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:27 devstack sudo[86384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:38:27 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:27 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-0661161f-4727-40e5-838d-41a93028e051 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.242s {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:27 devstack cinder-volume[86274]: INFO cinder.volume.driver [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG cinder.volume.driver [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8608856201172, 'free_capacity_gb': 1773.8608856201172, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86274) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG oslo_db.sqlalchemy.engines [None req-0661161f-4727-40e5-838d-41a93028e051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86274) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG dbcounter [-] [86274] Writer thread running {{(pid=86274) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG cinder.db.api [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Building query based on filter {{(pid=86274) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG cinder.image.image_utils [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86274) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 10:38:27 devstack cinder-volume[86274]: INFO cinder.keymgr.migration [None req-0a7da0fe-7661-463b-b31b-62dcea4d1d54 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG cinder.volume.drivers.quobyte [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=86274) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG cinder.volume.drivers.quobyte [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=86274) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:27 devstack sudo[86388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:38:27 devstack sudo[86388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:27 devstack sudo[86388]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-0661161f-4727-40e5-838d-41a93028e051 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.231s {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG cinder.manager [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Notifying Schedulers of capabilities ... {{(pid=86274) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:38:27 devstack cinder-volume[86274]: INFO cinder.volume.manager [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Driver initialization completed successfully. Nov 02 10:38:27 devstack cinder-volume[86274]: INFO cinder.manager [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Initiating service 3 cleanup Nov 02 10:38:27 devstack cinder-volume[86274]: INFO cinder.manager [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Service 3 cleanup completed. Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG cinder.service [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Creating RPC server for service cinder-volume {{(pid=86274) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG cinder.service [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86274) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 10:38:27 devstack cinder-volume[86274]: INFO cinder.volume.manager [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG cinder.volume.drivers.quobyte [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=86274) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG cinder.volume.drivers.quobyte [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=86274) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:27 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:27 devstack sudo[86391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:38:27 devstack sudo[86391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:28 devstack sudo[86391]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:28 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-0661161f-4727-40e5-838d-41a93028e051 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.283s {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:28 devstack cinder-volume[86274]: INFO cinder.volume.manager [None req-0661161f-4727-40e5-838d-41a93028e051 None None] Driver post RPC initialization completed successfully. Nov 02 10:38:33 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-116febd2-2458-4bfc-8ec3-451e5a781944 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:33 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-116febd2-2458-4bfc-8ec3-451e5a781944 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:33 devstack cinder-volume[86274]: DEBUG cinder.volume.drivers.quobyte [None req-116febd2-2458-4bfc-8ec3-451e5a781944 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=86274) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:33 devstack cinder-volume[86274]: DEBUG cinder.volume.drivers.quobyte [None req-116febd2-2458-4bfc-8ec3-451e5a781944 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=86274) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:33 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-116febd2-2458-4bfc-8ec3-451e5a781944 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:33 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-116febd2-2458-4bfc-8ec3-451e5a781944 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:33 devstack sudo[86588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:38:33 devstack sudo[86588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:33 devstack cinder-volume[86274]: DEBUG oslo_service.periodic_task [None req-67d292b0-411e-4418-b8e8-92562cd5aef9 None None] Running periodic task VolumeManager._thread_info {{(pid=86274) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:38:33 devstack cinder-volume[86274]: DEBUG cinder.volume.manager [None req-67d292b0-411e-4418-b8e8-92562cd5aef9 None None] thread count: 6 {{(pid=86274) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:38:33 devstack cinder-volume[86274]: DEBUG cinder.volume.manager [None req-67d292b0-411e-4418-b8e8-92562cd5aef9 None None] thread info: [<_MainThread(MainThread, started 128070712557696)>, , , , , ] {{(pid=86274) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:38:33 devstack sudo[86588]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:33 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-116febd2-2458-4bfc-8ec3-451e5a781944 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.241s {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:33 devstack cinder-volume[86274]: DEBUG cinder.manager [None req-116febd2-2458-4bfc-8ec3-451e5a781944 None None] Notifying Schedulers of capabilities ... {{(pid=86274) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:38:35 devstack cinder-volume[86052]: INFO oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Caught SIGTERM, stopping children Nov 02 10:38:35 devstack cinder-volume[86052]: DEBUG oslo_concurrency.lockutils [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Acquiring lock "singleton_lock" {{(pid=86052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:38:35 devstack cinder-volume[86052]: DEBUG oslo_concurrency.lockutils [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Acquired lock "singleton_lock" {{(pid=86052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:38:35 devstack cinder-volume[86052]: DEBUG oslo_concurrency.lockutils [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Releasing lock "singleton_lock" {{(pid=86052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:38:35 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Stop services. {{(pid=86052) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 10:38:35 devstack cinder-volume[86052]: DEBUG oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Killing children. {{(pid=86052) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 10:38:35 devstack cinder-volume[86052]: INFO oslo_service.backend._eventlet.service [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Waiting on 1 children to exit Nov 02 10:38:37 devstack cinder-volume[86274]: DEBUG dbcounter [-] [86274] Writing DB stats cinder:SELECT=2 {{(pid=86274) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:38:38 devstack cinder-volume[86274]: DEBUG dbcounter [-] [86274] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86274) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:38:40 devstack cinder-volume[86274]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Nov 02 10:38:40 devstack cinder-volume[86796]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 10:38:40 devstack cinder-volume[86796]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 10:38:40 devstack cinder-volume[86796]: we strongly recommend against using it for new projects. Nov 02 10:38:40 devstack cinder-volume[86796]: If you are already using Eventlet, we recommend migrating to a different Nov 02 10:38:40 devstack cinder-volume[86796]: framework. For more detail see Nov 02 10:38:40 devstack cinder-volume[86796]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 10:38:40 devstack cinder-volume[86796]: import eventlet # noqa Nov 02 10:38:41 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Acquiring lock "singleton_lock" {{(pid=86274) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:38:41 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Acquired lock "singleton_lock" {{(pid=86274) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:38:41 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Releasing lock "singleton_lock" {{(pid=86274) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:38:41 devstack cinder-volume[86274]: WARNING amqp [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 10:38:41 devstack cinder-volume[86274]: WARNING amqp [None req-7ec32074-f20a-4d3e-9e0e-2ec1bcc1ba6d None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 10:38:43 devstack cinder-volume[86796]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86796) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:38:43 devstack cinder-volume[86796]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86796) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:38:43 devstack cinder-volume[86796]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86796) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:38:44 devstack cinder-volume[86796]: INFO dbcounter [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] Registered counter for database cinder Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_db.sqlalchemy.engines [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86796) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG dbcounter [-] [86796] Writer thread running {{(pid=86796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:38:44 devstack cinder-volume[86796]: INFO cinder.rpc [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 10:38:44 devstack cinder-volume[86796]: INFO cinder.rpc [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_db.sqlalchemy.engines [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86796) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:38:44 devstack cinder-volume[86796]: INFO cinder.volume.manager [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] Determined volume DB was empty at startup. Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG cinder.volume.manager [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86796) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 10:38:44 devstack cinder-volume[86796]: WARNING stevedore.named [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 10:38:44 devstack cinder-volume[86796]: WARNING castellan.key_manager [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:38:44 devstack cinder-volume[86796]: WARNING cinder.keymgr.conf_key_mgr [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:38:44 devstack cinder-volume[86796]: INFO cinder.volume.manager [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_db.sqlalchemy.engines [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86796) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:38:44 devstack cinder-volume[86796]: INFO oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] Starting 1 workers Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] Started child 87084 {{(pid=86796) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] Full set of CONF: {{(pid=86796) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] ******************************************************************************** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] Configuration options gathered from: {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 10:38:44 devstack cinder-volume[87084]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] ================================================================================ {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] allow_availability_zone_fallback = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] allow_compression_on_image_upload = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] allowed_direct_url_schemes = [] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] api_rate_limit = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] auth_strategy = keystone {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_availability_zone = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_host = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_name = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_stats_polling_interval = 60 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backup_api_class = cinder.backup.api.API {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backup_name_template = backup-%s {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backup_use_same_host = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backup_use_temp_snapshot = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] chap_password = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] chap_username = {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cinder_internal_tenant_project_id = c1dcfab38ade4ffe83a889d9106cd9a6 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cinder_internal_tenant_user_id = d5d3bbf087424a118bfa157538ffebae {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cluster = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] compression_format = gzip {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] compute_api_class = cinder.compute.nova.API {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] config_dir = [] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] config_source = [] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] control_exchange = openstack {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] debug = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] default_availability_zone = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] default_group_type = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] default_volume_type = QuobyteHD {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] disk_geometry = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] driver_client_cert = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] driver_client_cert_key = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] driver_data_namespace = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] driver_ssl_cert_path = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] driver_ssl_cert_verify = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] driver_use_ssl = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] enable_new_services = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] enable_unsupported_driver = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] enabled_backends = ['QuobyteHD'] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] enforce_multipath_for_image_xfer = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] filter_function = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance_api_insecure = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance_api_servers = ['http://192.168.122.2/image'] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance_api_ssl_compression = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance_ca_certificates_file = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance_catalog_info = image:glance:publicURL {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance_certfile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance_keyfile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance_num_retries = 3 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance_request_timeout = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] goodness_function = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] graceful_shutdown_timeout = 5 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] group_api_class = cinder.group.api.API {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] host = devstack {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] image_compress_on_upload = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] image_conversion_address_space_limit = 1 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] image_conversion_cpu_limit = 60 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] image_conversion_disable = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] image_introspection_address_space_limit = 1 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] image_introspection_cpu_limit = 60 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] image_upload_use_cinder_backend = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] image_upload_use_internal_tenant = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] image_volume_cache_enabled = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] image_volume_cache_max_count = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] image_volume_cache_max_size_gb = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] init_host_max_objects_retrieval = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] instance_format = [instance: %(uuid)s] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] iscsi_target_flags = {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] iscsi_write_cache = on {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] iser_helper = tgtadm {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] iser_ip_address = 192.168.122.2 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] iser_port = 3260 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] log_color = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] log_config_append = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] log_dir = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] log_file = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] log_options = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] log_rotate_interval = 1 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] log_rotate_interval_type = days {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] log_rotation_type = none {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87084) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] max_age = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] max_logfile_count = 30 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] max_logfile_size_mb = 200 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] max_over_subscription_ratio = 20.0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] message_reap_interval = 86400 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] message_ttl = 2592000 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] migration_create_volume_timeout_secs = 300 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] monkey_patch = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] monkey_patch_modules = [] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] my_ip = 192.168.122.2 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] no_snapshot_gb_quota = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] num_iser_scan_tries = 3 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] num_shell_tries = 3 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] num_volume_device_scan_tries = 3 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] nvmeof_conn_info_version = 1 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] nvmet_ns_id = 10 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] nvmet_port_id = 1 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] osapi_max_limit = 1000 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] osapi_volume_ext_list = [] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] osapi_volume_listen_port = 8776 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] osapi_volume_use_ssl = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] osapi_volume_workers = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] per_volume_size_limit = -1 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] periodic_fuzzy_delay = 60 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] periodic_interval = 60 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] public_endpoint = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] publish_errors = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] quota_backup_gigabytes = 1000 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] quota_backups = 10 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] quota_gigabytes = 1000 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] quota_groups = 10 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] quota_snapshots = 10 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] quota_volumes = 10 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] rate_limit_burst = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] rate_limit_except_level = CRITICAL {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] rate_limit_interval = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] reinit_driver_count = 3 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] replication_device = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] report_discard_supported = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] report_interval = 120 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] reservation_clean_interval = 86400 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] reservation_expire = 86400 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] reserved_image_namespaces = [] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] reserved_percentage = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] rpc_response_timeout = 120 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] run_external_periodic_tasks = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] scst_target_driver = iscsi {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] scst_target_iqn_name = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] service_down_time = 720 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] shell_completion = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] snapshot_name_template = snapshot-%s {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] split_loggers = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] state_path = /opt/stack/data/cinder {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] storage_availability_zone = nova {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] storage_protocol = iSCSI {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] syslog_log_facility = LOG_USER {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] target_helper = lioadm {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] target_ip_address = 192.168.122.2 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] target_port = 3260 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] target_protocol = iscsi {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] target_secondary_ip_addresses = [] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] trace_flags = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] transport_url = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] until_refresh = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] use_chap_auth = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] use_default_quota_class = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] use_journal = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] use_json = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] use_multipath_for_image_xfer = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] use_stderr = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] use_syslog = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] verify_glance_signatures = enabled {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] volume_api_class = cinder.volume.api.API {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] volume_backend_name = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] volume_clear = zero {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] volume_clear_ionice = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] volume_clear_size = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] volume_copy_bps_limit = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] volume_dd_blocksize = 1M {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] volume_name_template = volume-%s {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] volume_service_inithost_offload = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] volume_usage_audit_period = month {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] zoning_mode = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_concurrency.disable_process_locking = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.auth_section = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.auth_type = password {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.auth_version = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.cache = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.certfile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.include_service_catalog = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.insecure = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.interface = public {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.keyfile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.memcache_password = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87084) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 10:38:44 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.quobyte [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.quobyte [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Running cmd (subprocess): mount.quobyte {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.memcache_username = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.region_name = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.service_type = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.2/identity {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.backend = dogpile.cache.null {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.backend_argument = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.backend_expiration_time = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.config_prefix = cache.oslo {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.debug_cache_backend = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.enable_retry_client = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.enable_socket_keepalive = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.enabled = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.expiration_time = 600 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.hashclient_retry_attempts = 2 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.memcache_dead_retry = 300 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.memcache_pool_maxsize = 10 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.memcache_sasl_enabled = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.password = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.proxies = [] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.redis_db = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.redis_server = localhost:6379 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.retry_attempts = 2 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.retry_delay = 0.0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.socket_keepalive_count = 1 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.socket_keepalive_idle = 1 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.socket_keepalive_interval = 1 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.socket_timeout = 1.0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.tls_allowed_ciphers = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.tls_cafile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.tls_certfile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.tls_enabled = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.tls_keyfile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cache.username = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] coordination.backend_url = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.asyncio_connection = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.asyncio_slave_connection = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.backend = sqlalchemy {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.connection = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.connection_debug = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.connection_parameters = {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.connection_recycle_time = 3600 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.connection_trace = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.db_inc_retry_interval = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.db_max_retries = 20 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.db_max_retry_interval = 10 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.db_retry_interval = 1 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.max_overflow = 50 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.max_pool_size = 5 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.max_retries = 10 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.mysql_wsrep_sync_wait = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.pool_timeout = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.retry_interval = 10 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.slave_connection = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.sqlite_synchronous = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.synchronous_reader = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] database.use_db_reconnect = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_tracing.insecure = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] profiler.connection_string = messaging:// {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] profiler.enabled = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] profiler.es_doc_type = notification {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] profiler.es_scroll_size = 10000 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] profiler.es_scroll_time = 2m {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] profiler.filter_error_trace = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] profiler.hmac_keys = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] profiler.sentinel_service_name = mymaster {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] profiler.socket_timeout = 0.1 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] profiler.trace_requests = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] profiler.trace_sqlalchemy = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] profiler_jaeger.process_tags = {} {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] profiler_jaeger.service_name_prefix = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] profiler_otlp.service_name_prefix = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_policy.enforce_new_defaults = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_policy.policy_default_rule = default {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_policy.policy_file = policy.yaml {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] privsep_osbrick.group = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] privsep_osbrick.helper_command = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] privsep_osbrick.user = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cinder_sys_admin.group = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cinder_sys_admin.helper_command = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] cinder_sys_admin.user = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] service_user.auth_section = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] service_user.auth_type = password {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] service_user.cafile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] service_user.certfile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] service_user.collect_timing = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] service_user.insecure = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] service_user.keyfile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] service_user.send_service_user_token = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] service_user.split_loggers = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] service_user.timeout = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] service_user.tls_ciphers = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] service_user.tls_min_version = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance.auth_section = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance.auth_type = password {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance.certfile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance.collect_timing = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance.insecure = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance.keyfile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance.region_name = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance.split_loggers = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance.timeout = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance.tls_ciphers = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] glance.tls_min_version = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.backend_availability_zone = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.chap_password = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.chap_username = {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.disk_geometry = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.driver_client_cert = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.driver_client_cert_key = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.driver_data_namespace = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.driver_use_ssl = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.extra_capabilities = {} {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.filter_function = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.goodness_function = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.iscsi_target_flags = {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.iscsi_write_cache = on {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.iser_helper = tgtadm {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.iser_ip_address = 192.168.122.2 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.iser_port = 3260 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.nas_host = {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.nas_login = admin {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.nas_mount_options = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.nas_password = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.nas_private_key = {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.nas_share_path = {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack quobyte-client[87085]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.num_shell_tries = 3 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack quobyte-client[87085]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] CMD "mount.quobyte" returned: 1 in 0.067s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.quobyte_volume_url = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.replication_device = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.report_discard_supported = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.reserved_percentage = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.target_helper = tgtadm {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.target_ip_address = 192.168.122.2 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.target_port = 3260 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.target_protocol = iscsi {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.trace_flags = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.unique_fqdn_network = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.use_chap_auth = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.volume_backend_name = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.volume_clear = zero {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.volume_clear_ionice = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.volume_clear_size = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:44 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_reports.file_event_handler = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_reports.log_dir = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.backend_availability_zone = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.backend_host = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.chap_password = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.chap_username = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.chiscsi_conf = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.disk_geometry = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.driver_client_cert = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.driver_data_namespace = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.driver_use_ssl = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.extra_capabilities = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.filter_function = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.goodness_function = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.iser_helper = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.iser_ip_address = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.iser_port = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.iser_target_prefix = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.nas_host = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.nas_login = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.nas_mount_options = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.nas_password = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.nas_private_key = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.nas_share_path = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.nas_ssh_port = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.num_shell_tries = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.nvmet_port_id = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.replication_device = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.report_discard_supported = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.reserved_percentage = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.scst_target_driver = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.storage_protocol = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.target_helper = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.target_ip_address = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.target_port = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.target_prefix = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack sudo[87086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.target_protocol = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.trace_flags = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack sudo[87086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.use_chap_auth = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.volume_clear = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.volume_clear_size = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] QuobyteHD.volumes_dir = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.ssl = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_notifications.driver = [] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_notifications.retry = -1 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] key_manager.fixed_key = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican.barbican_api_version = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican.barbican_endpoint = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican.barbican_endpoint_type = public {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican.barbican_region_name = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican.cafile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican.certfile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican.collect_timing = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican.insecure = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican.keyfile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican.number_of_retries = 60 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican.retry_delay = 1 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican.send_service_user_token = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican.split_loggers = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican.timeout = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican.tls_ciphers = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican.tls_min_version = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican.verify_ssl = True {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican.verify_ssl_path = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican_service_user.auth_section = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican_service_user.auth_type = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican_service_user.cafile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican_service_user.certfile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican_service_user.collect_timing = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican_service_user.insecure = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican_service_user.keyfile = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican_service_user.split_loggers = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican_service_user.timeout = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican_service_user.tls_ciphers = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] barbican_service_user.tls_min_version = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] vault.approle_role_id = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] vault.approle_secret_id = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] vault.auth_method = approle {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] vault.auth_path = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] vault.kv_mountpoint = secret {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] vault.kv_path = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] vault.kv_version = 2 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] vault.namespace = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] vault.root_token_id = **** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] vault.ssl_ca_crt_file = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] vault.timeout = 60.0 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] vault.token_file = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] vault.token_role = None {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] vault.use_ssl = False {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:38:45 devstack cinder-volume[86796]: DEBUG oslo_service.backend._eventlet.service [None req-660bf3ed-a7b7-487a-9510-0719daef5e96 None None] ******************************************************************************** {{(pid=86796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 10:38:45 devstack sudo[87086]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.254s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:45 devstack cinder-volume[87084]: INFO cinder.volume.driver [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG cinder.volume.driver [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8580207824707, 'free_capacity_gb': 1773.8580207824707, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87084) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG oslo_db.sqlalchemy.engines [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87084) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writer thread running {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG cinder.db.api [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Building query based on filter {{(pid=87084) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87084) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:45 devstack cinder-volume[87084]: INFO cinder.keymgr.migration [None req-a7ec1c0a-31a3-4be7-bf22-370c1d06bc1e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 10:38:45 devstack sudo[87089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:38:45 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:45 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.260s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:38:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Driver initialization completed successfully. Nov 02 10:38:45 devstack cinder-volume[87084]: INFO cinder.manager [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Initiating service 3 cleanup Nov 02 10:38:45 devstack cinder-volume[87084]: INFO cinder.manager [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Service 3 cleanup completed. Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG cinder.service [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Creating RPC server for service cinder-volume {{(pid=87084) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG cinder.service [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87084) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 10:38:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:38:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:38:45 devstack sudo[87092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:38:45 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:38:46 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root Nov 02 10:38:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.252s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:38:46 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b98b7f02-a0ae-412f-a8b7-4594d956fd00 None None] Driver post RPC initialization completed successfully. Nov 02 10:38:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:38:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 6 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:38:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:38:54 devstack cinder-volume[86796]: DEBUG dbcounter [-] [86796] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:38:55 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:38:56 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=3 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:39:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:39:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:39:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:39:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:39:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:39:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:39:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:53 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:39:53 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:53 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.590s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:39:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:39:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 6 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:39:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Flow 'volume_create_manager' (bb32aa37-df99-4a37-a9d9-bcdf593fddc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6389da1-fc0d-4378-bb61-130a186b9046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6389da1-fc0d-4378-bb61-130a186b9046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2109679016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707126da-9af9-4f02-a416-b804b1b52ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe4cd1091ff4ddf813e24e72a3fe6f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:40:08Z,use_quota=True,user_id='c862e54d785e4c7c81f4a79a8a599b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa757b92-83e5-4027-ad76-90cbd2dd6659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa757b92-83e5-4027-ad76-90cbd2dd6659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee7d323-b48b-4e1d-9972-797264e958b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee7d323-b48b-4e1d-9972-797264e958b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '707126da-9af9-4f02-a416-b804b1b52ec6', 'volume_name': 'volume-707126da-9af9-4f02-a416-b804b1b52ec6', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a5cfdd-e23e-4dec-97ca-b16739d94f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a5cfdd-e23e-4dec-97ca-b16739d94f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d26492-a3e3-45da-80f1-f3f69e2b23af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:08 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Volume 707126da-9af9-4f02-a416-b804b1b52ec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-707126da-9af9-4f02-a416-b804b1b52ec6', 'volume_size': 1} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2109679016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707126da-9af9-4f02-a416-b804b1b52ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe4cd1091ff4ddf813e24e72a3fe6f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:40:08Z,use_quota=True,user_id='c862e54d785e4c7c81f4a79a8a599b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Creating volume 707126da-9af9-4f02-a416-b804b1b52ec6 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:40:08 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:40:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-707126da-9af9-4f02-a416-b804b1b52ec6 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:08 devstack sudo[87697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-707126da-9af9-4f02-a416-b804b1b52ec6 1073741824 Nov 02 10:40:08 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:09 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-707126da-9af9-4f02-a416-b804b1b52ec6 1073741824" returned: 0 in 1.035s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-707126da-9af9-4f02-a416-b804b1b52ec6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:09 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-707126da-9af9-4f02-a416-b804b1b52ec6 Nov 02 10:40:09 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:10 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-707126da-9af9-4f02-a416-b804b1b52ec6" returned: 0 in 0.552s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:40:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d26492-a3e3-45da-80f1-f3f69e2b23af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-707126da-9af9-4f02-a416-b804b1b52ec6', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4861e088-cd4d-46f7-980c-0148929e0bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:10 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Volume volume-707126da-9af9-4f02-a416-b804b1b52ec6 (707126da-9af9-4f02-a416-b804b1b52ec6): created successfully Nov 02 10:40:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4861e088-cd4d-46f7-980c-0148929e0bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Flow 'volume_create_manager' (bb32aa37-df99-4a37-a9d9-bcdf593fddc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:40:10 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ae0bed9a-84e7-4c09-bce0-ca29a8344e44 tempest-VolumesAdminNegativeTest-678828612 None] Created volume successfully. Nov 02 10:40:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Acquiring lock "cinder-707126da-9af9-4f02-a416-b804b1b52ec6-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Lock "cinder-707126da-9af9-4f02-a416-b804b1b52ec6-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Acquiring lock "cinder-quobyte-707126da-9af9-4f02-a416-b804b1b52ec6" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:40:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Lock "cinder-quobyte-707126da-9af9-4f02-a416-b804b1b52ec6" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:40:11 devstack cinder-volume[87084]: INFO oslo.privsep.daemon [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmplyxmkppy/privsep.sock'] Nov 02 10:40:11 devstack sudo[88019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmplyxmkppy/privsep.sock Nov 02 10:40:11 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:12 devstack cinder-volume[87084]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 02 10:40:12 devstack cinder-volume[87084]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 10:40:12 devstack cinder-volume[87084]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 02 10:40:12 devstack cinder-volume[87084]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 10:40:12 devstack cinder-volume[87084]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 02 10:40:12 devstack cinder-volume[87084]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 02 10:40:12 devstack cinder-volume[87084]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 10:40:12 devstack cinder-volume[87084]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 10:40:12 devstack cinder-volume[87084]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 02 10:40:13 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:13 devstack cinder-volume[87084]: INFO oslo.privsep.daemon [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Spawned new privsep daemon via rootwrap Nov 02 10:40:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Accepted privsep connection to /tmp/tmplyxmkppy/privsep.sock {{(pid=87084) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 02 10:40:13 devstack cinder-volume[87084]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 02 10:40:13 devstack cinder-volume[87084]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 02 10:40:13 devstack cinder-volume[87084]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 02 10:40:13 devstack cinder-volume[87084]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88022 Nov 02 10:40:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d15c404-62e2-4641-8b06-a447bd70debb]: (2,) {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[349d9506-4673-49e8-a5fd-ddc687f0c136]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:40:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-707126da-9af9-4f02-a416-b804b1b52ec6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:13 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-707126da-9af9-4f02-a416-b804b1b52ec6 Nov 02 10:40:13 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:14 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-707126da-9af9-4f02-a416-b804b1b52ec6" returned: 0 in 0.810s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-707126da-9af9-4f02-a416-b804b1b52ec6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:14 devstack sudo[88029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-707126da-9af9-4f02-a416-b804b1b52ec6 Nov 02 10:40:14 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:14 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-707126da-9af9-4f02-a416-b804b1b52ec6" returned: 0 in 0.389s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Lock "cinder-quobyte-707126da-9af9-4f02-a416-b804b1b52ec6" released by "delete_volume" :: held 2.795s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:14 devstack cinder-volume[87084]: WARNING cinder.quota [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:40:14 devstack cinder-volume[87084]: WARNING cinder.quota [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:40:14 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Created reservations ['0b03f984-f108-494e-a663-c78bec490318', 'ab6c5762-6a0f-4919-b362-4055cc062bec', '59286c50-f5e9-4324-b4d9-7b04b49d1e0a', 'b1389b82-735b-455c-be5d-3c5e81f6498a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:40:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:14 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:40:14 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:15 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.440s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:15 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:40:15 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Deleted volume successfully. Nov 02 10:40:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-727af752-56bb-4cd8-bf36-0e9238b72f2b tempest-VolumesAdminNegativeTest-678828612 None] Lock "cinder-707126da-9af9-4f02-a416-b804b1b52ec6-delete_volume" released by "delete_volume" :: held 3.775s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:40:24 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=3 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:40:25 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=11,cinder:SELECT=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Flow 'volume_create_manager' (2eeacd26-8267-4b49-bdb2-79adbf60ecd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103ebcad-5790-4faf-acf8-f0a9f570a130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103ebcad-5790-4faf-acf8-f0a9f570a130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1310386014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7221a1f-5057-472f-a872-5c7c83a7b5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd286df42ec439cad53f287af64fd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:40:28Z,use_quota=True,user_id='674c79438a96441ab9974c2c7106f48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea1cf7a-452b-438e-a80b-4e3a96255869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea1cf7a-452b-438e-a80b-4e3a96255869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (055c49f7-2548-45bd-a21d-ca1ede7434c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (055c49f7-2548-45bd-a21d-ca1ede7434c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7221a1f-5057-472f-a872-5c7c83a7b5b7', 'volume_name': 'volume-c7221a1f-5057-472f-a872-5c7c83a7b5b7', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ea6665-a362-427a-8c86-fb31dc6fd84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ea6665-a362-427a-8c86-fb31dc6fd84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513d399a-cb5a-4b7b-b668-04dcadbeb205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:28 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Volume c7221a1f-5057-472f-a872-5c7c83a7b5b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7221a1f-5057-472f-a872-5c7c83a7b5b7', 'volume_size': 1} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1310386014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7221a1f-5057-472f-a872-5c7c83a7b5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd286df42ec439cad53f287af64fd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:40:28Z,use_quota=True,user_id='674c79438a96441ab9974c2c7106f48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Creating volume c7221a1f-5057-472f-a872-5c7c83a7b5b7 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:40:28 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c7221a1f-5057-472f-a872-5c7c83a7b5b7 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:28 devstack sudo[88172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c7221a1f-5057-472f-a872-5c7c83a7b5b7 1073741824 Nov 02 10:40:28 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:28 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c7221a1f-5057-472f-a872-5c7c83a7b5b7 1073741824" returned: 0 in 0.549s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c7221a1f-5057-472f-a872-5c7c83a7b5b7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:28 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c7221a1f-5057-472f-a872-5c7c83a7b5b7 Nov 02 10:40:28 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:29 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c7221a1f-5057-472f-a872-5c7c83a7b5b7" returned: 0 in 0.302s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:40:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513d399a-cb5a-4b7b-b668-04dcadbeb205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7221a1f-5057-472f-a872-5c7c83a7b5b7', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9846c70e-f91c-4b19-891c-f5b3e0ed32bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:29 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Volume volume-c7221a1f-5057-472f-a872-5c7c83a7b5b7 (c7221a1f-5057-472f-a872-5c7c83a7b5b7): created successfully Nov 02 10:40:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9846c70e-f91c-4b19-891c-f5b3e0ed32bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Flow 'volume_create_manager' (2eeacd26-8267-4b49-bdb2-79adbf60ecd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:40:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5ffe7901-0e8d-4325-8ea0-498f9383cd76 tempest-AttachVolumeTestJSON-1499566554 None] Created volume successfully. Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Flow 'volume_create_manager' (37e0aa71-c3f0-458d-a250-0550c48d7620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1309b53-706c-414c-9fbb-3e5531d9e50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1309b53-706c-414c-9fbb-3e5531d9e50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1497268782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6a5270-025c-4448-9154-e720df67d183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e007ed2da92f4f69b83b58dede178fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:40:30Z,use_quota=True,user_id='05a07ce168d7480899c2a681766db7f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f964ce5-173b-44c6-a0d0-a266faac5da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f964ce5-173b-44c6-a0d0-a266faac5da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c767fc25-b66e-4fc3-abd5-9d9b00668c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c767fc25-b66e-4fc3-abd5-9d9b00668c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de6a5270-025c-4448-9154-e720df67d183', 'volume_name': 'volume-de6a5270-025c-4448-9154-e720df67d183', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (626e97be-79f3-4fda-96aa-f9d2c87aa3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (626e97be-79f3-4fda-96aa-f9d2c87aa3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27f0a5c-c0a6-44fc-b877-1e69b0730937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:30 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Volume de6a5270-025c-4448-9154-e720df67d183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de6a5270-025c-4448-9154-e720df67d183', 'volume_size': 1} Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1497268782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6a5270-025c-4448-9154-e720df67d183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e007ed2da92f4f69b83b58dede178fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:40:30Z,use_quota=True,user_id='05a07ce168d7480899c2a681766db7f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Creating volume de6a5270-025c-4448-9154-e720df67d183 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:40:30 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:40:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-de6a5270-025c-4448-9154-e720df67d183 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:30 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-de6a5270-025c-4448-9154-e720df67d183 1073741824 Nov 02 10:40:30 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:31 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-de6a5270-025c-4448-9154-e720df67d183 1073741824" returned: 0 in 0.654s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-de6a5270-025c-4448-9154-e720df67d183 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:31 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-de6a5270-025c-4448-9154-e720df67d183 Nov 02 10:40:31 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:31 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-de6a5270-025c-4448-9154-e720df67d183" returned: 0 in 0.355s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:40:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27f0a5c-c0a6-44fc-b877-1e69b0730937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de6a5270-025c-4448-9154-e720df67d183', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce9a620-cc45-4548-823d-6bd56debca6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:40:31 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Volume volume-de6a5270-025c-4448-9154-e720df67d183 (de6a5270-025c-4448-9154-e720df67d183): created successfully Nov 02 10:40:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce9a620-cc45-4548-823d-6bd56debca6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:40:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Flow 'volume_create_manager' (37e0aa71-c3f0-458d-a250-0550c48d7620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:40:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b80bf7e6-94f1-46e6-813b-7592636c9b84 tempest-AttachVolumeShelveTestJSON-2074505820 None] Created volume successfully. Nov 02 10:40:33 devstack cinder-volume[87084]: WARNING py.warnings [req-484deffe-8617-4e24-82d3-bf727c1cf033 req-c1b0b67e-4563-4878-9357-301b58a6ef19 tempest-AttachVolumeTestJSON-1499566554 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 02 10:40:33 devstack cinder-volume[87084]: .first() Nov 02 10:40:33 devstack cinder-volume[87084]: Nov 02 10:40:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-484deffe-8617-4e24-82d3-bf727c1cf033 req-c1b0b67e-4563-4878-9357-301b58a6ef19 tempest-AttachVolumeTestJSON-1499566554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-484deffe-8617-4e24-82d3-bf727c1cf033 req-c1b0b67e-4563-4878-9357-301b58a6ef19 tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-484deffe-8617-4e24-82d3-bf727c1cf033 req-c1b0b67e-4563-4878-9357-301b58a6ef19 tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-484deffe-8617-4e24-82d3-bf727c1cf033 req-c1b0b67e-4563-4878-9357-301b58a6ef19 tempest-AttachVolumeTestJSON-1499566554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-c7221a1f-5057-472f-a872-5c7c83a7b5b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91d15ae0-c016-46f0-bae1-bfef3737fb60', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:40:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-484deffe-8617-4e24-82d3-bf727c1cf033 req-c1b0b67e-4563-4878-9357-301b58a6ef19 tempest-AttachVolumeTestJSON-1499566554 None] attachment_update completed successfully. Nov 02 10:40:43 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=12,cinder:UPDATE=7,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:40:43 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=8,cinder:SELECT=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:40:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:40:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:40:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:40:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:40:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:40:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:40:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:53 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:40:53 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:53 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.441s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:40:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:40:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 8 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:40:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:40:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-b4d7eaf7-76da-46dd-8fa8-3ab93582e08d req-6e8dbd36-d059-477c-88e3-aed5ad59bd42 tempest-AttachVolumeShelveTestJSON-2074505820 None] No connector for attachment a3cc5740-6969-489f-9873-ef1d91de4654; skipping storage backend terminate_connection call. {{(pid=87084) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 02 10:40:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-b4d7eaf7-76da-46dd-8fa8-3ab93582e08d req-6e8dbd36-d059-477c-88e3-aed5ad59bd42 tempest-AttachVolumeShelveTestJSON-2074505820 None] Deleting attachment a3cc5740-6969-489f-9873-ef1d91de4654. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Flow 'volume_create_manager' (fef0a467-784f-462b-8622-a66b6265cb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be5d63e9-0aab-496e-b87a-4e3efce093c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be5d63e9-0aab-496e-b87a-4e3efce093c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1012539202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a64e2a6-8f00-4966-9d03-d4a30532a6ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a73fa486fc604c06a020db75c9533d4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:41:04Z,use_quota=True,user_id='ad797a0dbd7040c0b775b2b426bc8c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc62f35-45bd-4bf6-a6e8-778887cb5608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc62f35-45bd-4bf6-a6e8-778887cb5608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa1903e-5a8f-4ef0-bc2e-01692523b967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa1903e-5a8f-4ef0-bc2e-01692523b967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a64e2a6-8f00-4966-9d03-d4a30532a6ba', 'volume_name': 'volume-9a64e2a6-8f00-4966-9d03-d4a30532a6ba', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823a3e1b-5670-4d81-8b23-f7a08d0e3645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823a3e1b-5670-4d81-8b23-f7a08d0e3645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8dc4f2-7937-4b8a-913b-4d5fbde092a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:03 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Volume 9a64e2a6-8f00-4966-9d03-d4a30532a6ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a64e2a6-8f00-4966-9d03-d4a30532a6ba', 'volume_size': 1} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1012539202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a64e2a6-8f00-4966-9d03-d4a30532a6ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a73fa486fc604c06a020db75c9533d4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:41:04Z,use_quota=True,user_id='ad797a0dbd7040c0b775b2b426bc8c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Creating volume 9a64e2a6-8f00-4966-9d03-d4a30532a6ba {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:41:03 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:41:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9a64e2a6-8f00-4966-9d03-d4a30532a6ba 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:03 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9a64e2a6-8f00-4966-9d03-d4a30532a6ba 1073741824 Nov 02 10:41:03 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:04 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9a64e2a6-8f00-4966-9d03-d4a30532a6ba 1073741824" returned: 0 in 1.120s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9a64e2a6-8f00-4966-9d03-d4a30532a6ba {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:05 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9a64e2a6-8f00-4966-9d03-d4a30532a6ba Nov 02 10:41:05 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:05 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9a64e2a6-8f00-4966-9d03-d4a30532a6ba" returned: 0 in 0.417s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:41:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8dc4f2-7937-4b8a-913b-4d5fbde092a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a64e2a6-8f00-4966-9d03-d4a30532a6ba', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bed4771-6b2c-48a6-8ab5-6cdd4e6abd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:05 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Volume volume-9a64e2a6-8f00-4966-9d03-d4a30532a6ba (9a64e2a6-8f00-4966-9d03-d4a30532a6ba): created successfully Nov 02 10:41:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bed4771-6b2c-48a6-8ab5-6cdd4e6abd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Flow 'volume_create_manager' (fef0a467-784f-462b-8622-a66b6265cb0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:41:05 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f7cdea49-0813-403b-be9e-e3ba17c392fe tempest-TaggedAttachmentsTest-2065569614 None] Created volume successfully. Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Flow 'volume_create_manager' (8dc0e061-fbf0-4fdf-b907-459e55eaca59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33aa508-a090-4748-912f-87342bd0c5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33aa508-a090-4748-912f-87342bd0c5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-439268044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=077f2fa1-4fe9-426c-b4bd-b35dd571a0fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626fa5f9161149f2a0748e2ea56a27b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:41:07Z,use_quota=True,user_id='697cec6b9b0843cd96cd1213f802bb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81225ea7-e3e6-471a-85f7-dc7a0927c3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81225ea7-e3e6-471a-85f7-dc7a0927c3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b744a35-148f-48b3-86bd-20fb8bea0e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b744a35-148f-48b3-86bd-20fb8bea0e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '077f2fa1-4fe9-426c-b4bd-b35dd571a0fb', 'volume_name': 'volume-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe9ca9a2-0bbf-4924-85e1-3d4b4aaaef79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe9ca9a2-0bbf-4924-85e1-3d4b4aaaef79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8617f85b-bcb8-44e4-aec1-23282c4638ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:07 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Volume 077f2fa1-4fe9-426c-b4bd-b35dd571a0fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb', 'volume_size': 1} Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-439268044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=077f2fa1-4fe9-426c-b4bd-b35dd571a0fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626fa5f9161149f2a0748e2ea56a27b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:41:07Z,use_quota=True,user_id='697cec6b9b0843cd96cd1213f802bb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Creating volume 077f2fa1-4fe9-426c-b4bd-b35dd571a0fb {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:41:07 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:41:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:07 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb 1073741824 Nov 02 10:41:07 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:08 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb 1073741824" returned: 0 in 0.996s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:08 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb Nov 02 10:41:08 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:08 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-217a2e50-0846-4924-adea-4ee273e625bc req-8c105991-8e49-4219-9c43-79787d75914e tempest-AttachVolumeTestJSON-1499566554 None] Terminate volume connection completed successfully. Nov 02 10:41:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-217a2e50-0846-4924-adea-4ee273e625bc req-8c105991-8e49-4219-9c43-79787d75914e tempest-AttachVolumeTestJSON-1499566554 None] Deleting attachment 91d15ae0-c016-46f0-bae1-bfef3737fb60. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:41:09 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb" returned: 0 in 0.345s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:41:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8617f85b-bcb8-44e4-aec1-23282c4638ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea7bbd1-ab89-44b6-a553-308446fda69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:41:09 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Volume volume-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb (077f2fa1-4fe9-426c-b4bd-b35dd571a0fb): created successfully Nov 02 10:41:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea7bbd1-ab89-44b6-a553-308446fda69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:41:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Flow 'volume_create_manager' (8dc0e061-fbf0-4fdf-b907-459e55eaca59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:41:09 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d72e70d6-7ab9-4786-a88b-626ddcc10215 tempest-DeleteServersTestJSON-522748531 None] Created volume successfully. Nov 02 10:41:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-c226d181-f1f5-4641-90d4-9841208fd2e2 req-6bdd2f40-1d4a-42c0-8d74-b0a6528660e4 tempest-DeleteServersTestJSON-522748531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-c226d181-f1f5-4641-90d4-9841208fd2e2 req-6bdd2f40-1d4a-42c0-8d74-b0a6528660e4 tempest-DeleteServersTestJSON-522748531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-c226d181-f1f5-4641-90d4-9841208fd2e2 req-6bdd2f40-1d4a-42c0-8d74-b0a6528660e4 tempest-DeleteServersTestJSON-522748531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-c226d181-f1f5-4641-90d4-9841208fd2e2 req-6bdd2f40-1d4a-42c0-8d74-b0a6528660e4 tempest-DeleteServersTestJSON-522748531 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec099431-ff17-415e-8b45-62f29b9d86d2', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:41:11 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-c226d181-f1f5-4641-90d4-9841208fd2e2 req-6bdd2f40-1d4a-42c0-8d74-b0a6528660e4 tempest-DeleteServersTestJSON-522748531 None] attachment_update completed successfully. Nov 02 10:41:20 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-4e7b3ad4-7e33-4b06-abdc-a9981f40ee8e req-d7549b8a-fb99-4905-80ba-283c09d77726 tempest-DeleteServersTestJSON-522748531 None] Terminate volume connection completed successfully. Nov 02 10:41:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-4e7b3ad4-7e33-4b06-abdc-a9981f40ee8e req-d7549b8a-fb99-4905-80ba-283c09d77726 tempest-DeleteServersTestJSON-522748531 None] Deleting attachment ec099431-ff17-415e-8b45-62f29b9d86d2. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:41:21 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=13,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:41:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-87ff8753-15c5-4c2a-9bdd-de28374a6eb1 tempest-DeleteServersTestJSON-522748531 None] Acquiring lock "cinder-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:41:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-87ff8753-15c5-4c2a-9bdd-de28374a6eb1 tempest-DeleteServersTestJSON-522748531 None] Lock "cinder-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:41:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-87ff8753-15c5-4c2a-9bdd-de28374a6eb1 tempest-DeleteServersTestJSON-522748531 None] Acquiring lock "cinder-quobyte-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:41:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-87ff8753-15c5-4c2a-9bdd-de28374a6eb1 tempest-DeleteServersTestJSON-522748531 None] Lock "cinder-quobyte-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:41:22 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13987f2-b41b-47cc-82b1-72cce7ef84b4]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:41:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-87ff8753-15c5-4c2a-9bdd-de28374a6eb1 tempest-DeleteServersTestJSON-522748531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:22 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb Nov 02 10:41:22 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:22 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-87ff8753-15c5-4c2a-9bdd-de28374a6eb1 tempest-DeleteServersTestJSON-522748531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb" returned: 0 in 0.452s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-87ff8753-15c5-4c2a-9bdd-de28374a6eb1 tempest-DeleteServersTestJSON-522748531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:22 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb Nov 02 10:41:22 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:23 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-87ff8753-15c5-4c2a-9bdd-de28374a6eb1 tempest-DeleteServersTestJSON-522748531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb" returned: 0 in 0.284s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-87ff8753-15c5-4c2a-9bdd-de28374a6eb1 tempest-DeleteServersTestJSON-522748531 None] Lock "cinder-quobyte-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb" released by "delete_volume" :: held 0.806s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:23 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-87ff8753-15c5-4c2a-9bdd-de28374a6eb1 tempest-DeleteServersTestJSON-522748531 None] Created reservations ['ecd94ea3-bfac-4ab8-82d2-2baa68c58f2c', 'f7a8af51-0e79-400f-b90e-0ee879c86bc3', '1a324a80-9e65-4d55-a817-26d8dedea4c0', 'ab6f9534-e22c-4ee0-9a28-950825115dc7'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:41:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-87ff8753-15c5-4c2a-9bdd-de28374a6eb1 tempest-DeleteServersTestJSON-522748531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-87ff8753-15c5-4c2a-9bdd-de28374a6eb1 tempest-DeleteServersTestJSON-522748531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-87ff8753-15c5-4c2a-9bdd-de28374a6eb1 tempest-DeleteServersTestJSON-522748531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-87ff8753-15c5-4c2a-9bdd-de28374a6eb1 tempest-DeleteServersTestJSON-522748531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-87ff8753-15c5-4c2a-9bdd-de28374a6eb1 tempest-DeleteServersTestJSON-522748531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.074s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-87ff8753-15c5-4c2a-9bdd-de28374a6eb1 tempest-DeleteServersTestJSON-522748531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:23 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:41:23 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:23 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-87ff8753-15c5-4c2a-9bdd-de28374a6eb1 tempest-DeleteServersTestJSON-522748531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.422s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:23 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-87ff8753-15c5-4c2a-9bdd-de28374a6eb1 tempest-DeleteServersTestJSON-522748531 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:41:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-87ff8753-15c5-4c2a-9bdd-de28374a6eb1 tempest-DeleteServersTestJSON-522748531 None] Deleted volume successfully. Nov 02 10:41:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-87ff8753-15c5-4c2a-9bdd-de28374a6eb1 tempest-DeleteServersTestJSON-522748531 None] Lock "cinder-077f2fa1-4fe9-426c-b4bd-b35dd571a0fb-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:33 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=19,cinder:INSERT=5,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:41:33 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:41:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e3c6cc9e-ec68-456b-987d-a625cc3779a4 tempest-AttachVolumeShelveTestJSON-2074505820 None] Acquiring lock "cinder-de6a5270-025c-4448-9154-e720df67d183-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:41:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e3c6cc9e-ec68-456b-987d-a625cc3779a4 tempest-AttachVolumeShelveTestJSON-2074505820 None] Lock "cinder-de6a5270-025c-4448-9154-e720df67d183-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:41:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e3c6cc9e-ec68-456b-987d-a625cc3779a4 tempest-AttachVolumeShelveTestJSON-2074505820 None] Acquiring lock "cinder-quobyte-de6a5270-025c-4448-9154-e720df67d183" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:41:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e3c6cc9e-ec68-456b-987d-a625cc3779a4 tempest-AttachVolumeShelveTestJSON-2074505820 None] Lock "cinder-quobyte-de6a5270-025c-4448-9154-e720df67d183" acquired by "delete_volume" :: waited 0.036s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:41:44 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[30725a38-6809-410a-ba11-4b28a88eda77]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:41:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e3c6cc9e-ec68-456b-987d-a625cc3779a4 tempest-AttachVolumeShelveTestJSON-2074505820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-de6a5270-025c-4448-9154-e720df67d183 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:44 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-de6a5270-025c-4448-9154-e720df67d183 Nov 02 10:41:44 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:45 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e3c6cc9e-ec68-456b-987d-a625cc3779a4 tempest-AttachVolumeShelveTestJSON-2074505820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-de6a5270-025c-4448-9154-e720df67d183" returned: 0 in 0.460s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e3c6cc9e-ec68-456b-987d-a625cc3779a4 tempest-AttachVolumeShelveTestJSON-2074505820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-de6a5270-025c-4448-9154-e720df67d183 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:45 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-de6a5270-025c-4448-9154-e720df67d183 Nov 02 10:41:45 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:45 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e3c6cc9e-ec68-456b-987d-a625cc3779a4 tempest-AttachVolumeShelveTestJSON-2074505820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-de6a5270-025c-4448-9154-e720df67d183" returned: 0 in 0.295s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e3c6cc9e-ec68-456b-987d-a625cc3779a4 tempest-AttachVolumeShelveTestJSON-2074505820 None] Lock "cinder-quobyte-de6a5270-025c-4448-9154-e720df67d183" released by "delete_volume" :: held 0.822s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:45 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-e3c6cc9e-ec68-456b-987d-a625cc3779a4 tempest-AttachVolumeShelveTestJSON-2074505820 None] Created reservations ['b1ee40ec-84ab-4597-8b3e-1ade8b3cc604', '2cbf5f65-c4b5-4f6c-a496-ace6c1a62aa7', '37752010-493b-48e7-92cd-0457aa775f87', '4ec97140-45d7-43c9-a972-638b6d797eeb'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:41:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e3c6cc9e-ec68-456b-987d-a625cc3779a4 tempest-AttachVolumeShelveTestJSON-2074505820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e3c6cc9e-ec68-456b-987d-a625cc3779a4 tempest-AttachVolumeShelveTestJSON-2074505820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e3c6cc9e-ec68-456b-987d-a625cc3779a4 tempest-AttachVolumeShelveTestJSON-2074505820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e3c6cc9e-ec68-456b-987d-a625cc3779a4 tempest-AttachVolumeShelveTestJSON-2074505820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e3c6cc9e-ec68-456b-987d-a625cc3779a4 tempest-AttachVolumeShelveTestJSON-2074505820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e3c6cc9e-ec68-456b-987d-a625cc3779a4 tempest-AttachVolumeShelveTestJSON-2074505820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:45 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:41:45 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:46 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e3c6cc9e-ec68-456b-987d-a625cc3779a4 tempest-AttachVolumeShelveTestJSON-2074505820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.394s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:46 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-e3c6cc9e-ec68-456b-987d-a625cc3779a4 tempest-AttachVolumeShelveTestJSON-2074505820 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:41:46 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e3c6cc9e-ec68-456b-987d-a625cc3779a4 tempest-AttachVolumeShelveTestJSON-2074505820 None] Deleted volume successfully. Nov 02 10:41:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e3c6cc9e-ec68-456b-987d-a625cc3779a4 tempest-AttachVolumeShelveTestJSON-2074505820 None] Lock "cinder-de6a5270-025c-4448-9154-e720df67d183-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:41:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:41:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:41:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:41:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:41:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:41:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:41:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:53 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:41:53 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:53 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.316s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:41:55 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=3,cinder:INSERT=4,cinder:UPDATE=8 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:41:56 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=8,cinder:SELECT=7,cinder:DELETE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:42:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-0c51b712-4254-47ca-9385-1b2bed3f11e9 req-c44d4ae4-f6f9-4457-bd7a-bbad47e1fe2e tempest-TaggedAttachmentsTest-2065569614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-0c51b712-4254-47ca-9385-1b2bed3f11e9 req-c44d4ae4-f6f9-4457-bd7a-bbad47e1fe2e tempest-TaggedAttachmentsTest-2065569614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-0c51b712-4254-47ca-9385-1b2bed3f11e9 req-c44d4ae4-f6f9-4457-bd7a-bbad47e1fe2e tempest-TaggedAttachmentsTest-2065569614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-0c51b712-4254-47ca-9385-1b2bed3f11e9 req-c44d4ae4-f6f9-4457-bd7a-bbad47e1fe2e tempest-TaggedAttachmentsTest-2065569614 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-9a64e2a6-8f00-4966-9d03-d4a30532a6ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da9f3255-3f89-48cc-863a-fd3b5182f70e', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:42:15 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-0c51b712-4254-47ca-9385-1b2bed3f11e9 req-c44d4ae4-f6f9-4457-bd7a-bbad47e1fe2e tempest-TaggedAttachmentsTest-2065569614 None] attachment_update completed successfully. Nov 02 10:42:19 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-a16e34fb-db36-4f7a-8543-f8abeaa7d89a req-07d1103f-f4b7-4419-b0c7-def53006c178 tempest-TaggedAttachmentsTest-2065569614 None] Terminate volume connection completed successfully. Nov 02 10:42:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-a16e34fb-db36-4f7a-8543-f8abeaa7d89a req-07d1103f-f4b7-4419-b0c7-def53006c178 tempest-TaggedAttachmentsTest-2065569614 None] Deleting attachment da9f3255-3f89-48cc-863a-fd3b5182f70e. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Flow 'volume_create_manager' (89fa731e-46a7-4ba7-8942-3f423b1d2c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796a0e00-de04-4d3e-9594-6dcd99ff3d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796a0e00-de04-4d3e-9594-6dcd99ff3d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1262424065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1d5aae-8a1f-42f5-b71e-1f41904a70b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc50d90b5b445768a0db86c5766bd8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:24Z,use_quota=True,user_id='10d7477215a64dc2ada2c9fdd2052f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271d3648-74c4-4e2f-8e67-f97f998ec710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271d3648-74c4-4e2f-8e67-f97f998ec710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea61a4a8-cd6a-4b27-a56b-d19a6ad321d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea61a4a8-cd6a-4b27-a56b-d19a6ad321d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c1d5aae-8a1f-42f5-b71e-1f41904a70b3', 'volume_name': 'volume-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425eb2e9-25a8-4608-92da-98015cbbd496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425eb2e9-25a8-4608-92da-98015cbbd496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7935753f-e851-4194-8121-44899b71609a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:24 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Volume 4c1d5aae-8a1f-42f5-b71e-1f41904a70b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3', 'volume_size': 1} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1262424065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1d5aae-8a1f-42f5-b71e-1f41904a70b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc50d90b5b445768a0db86c5766bd8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:24Z,use_quota=True,user_id='10d7477215a64dc2ada2c9fdd2052f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Creating volume 4c1d5aae-8a1f-42f5-b71e-1f41904a70b3 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:42:24 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:42:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:24 devstack sudo[91261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3 1073741824 Nov 02 10:42:24 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:25 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3 1073741824" returned: 0 in 0.803s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:25 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3 Nov 02 10:42:25 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:26 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3" returned: 0 in 0.760s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:42:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7935753f-e851-4194-8121-44899b71609a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79fda843-d72f-498a-a645-21a685276852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:26 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Volume volume-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3 (4c1d5aae-8a1f-42f5-b71e-1f41904a70b3): created successfully Nov 02 10:42:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79fda843-d72f-498a-a645-21a685276852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Flow 'volume_create_manager' (89fa731e-46a7-4ba7-8942-3f423b1d2c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:26 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-21799cb7-a2cc-45c2-b940-c7b63568df89 tempest-ServerActionsTestOtherA-509339523 None] Created volume successfully. Nov 02 10:42:36 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:42:36 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:42:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bce87a47-5f4f-458a-b0de-e08ba94e398f tempest-TaggedAttachmentsTest-2065569614 None] Acquiring lock "cinder-9a64e2a6-8f00-4966-9d03-d4a30532a6ba-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bce87a47-5f4f-458a-b0de-e08ba94e398f tempest-TaggedAttachmentsTest-2065569614 None] Lock "cinder-9a64e2a6-8f00-4966-9d03-d4a30532a6ba-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bce87a47-5f4f-458a-b0de-e08ba94e398f tempest-TaggedAttachmentsTest-2065569614 None] Acquiring lock "cinder-quobyte-9a64e2a6-8f00-4966-9d03-d4a30532a6ba" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:42:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bce87a47-5f4f-458a-b0de-e08ba94e398f tempest-TaggedAttachmentsTest-2065569614 None] Lock "cinder-quobyte-9a64e2a6-8f00-4966-9d03-d4a30532a6ba" acquired by "delete_volume" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:42:37 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5f2cab-2d92-403c-b3f9-49c3c3c3204f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:42:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bce87a47-5f4f-458a-b0de-e08ba94e398f tempest-TaggedAttachmentsTest-2065569614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9a64e2a6-8f00-4966-9d03-d4a30532a6ba {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:37 devstack sudo[91350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9a64e2a6-8f00-4966-9d03-d4a30532a6ba Nov 02 10:42:37 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:37 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bce87a47-5f4f-458a-b0de-e08ba94e398f tempest-TaggedAttachmentsTest-2065569614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9a64e2a6-8f00-4966-9d03-d4a30532a6ba" returned: 0 in 0.516s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bce87a47-5f4f-458a-b0de-e08ba94e398f tempest-TaggedAttachmentsTest-2065569614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9a64e2a6-8f00-4966-9d03-d4a30532a6ba {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:37 devstack sudo[91355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9a64e2a6-8f00-4966-9d03-d4a30532a6ba Nov 02 10:42:37 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:38 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bce87a47-5f4f-458a-b0de-e08ba94e398f tempest-TaggedAttachmentsTest-2065569614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9a64e2a6-8f00-4966-9d03-d4a30532a6ba" returned: 0 in 0.284s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bce87a47-5f4f-458a-b0de-e08ba94e398f tempest-TaggedAttachmentsTest-2065569614 None] Lock "cinder-quobyte-9a64e2a6-8f00-4966-9d03-d4a30532a6ba" released by "delete_volume" :: held 0.859s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:38 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-bce87a47-5f4f-458a-b0de-e08ba94e398f tempest-TaggedAttachmentsTest-2065569614 None] Created reservations ['d982d316-3650-468b-b873-3f1b7fef2008', 'c7bb1b4e-8ab2-4ceb-8b67-9b633bbbc2e4', 'cd8ace3e-5e01-4f1b-8ab3-ce0bb38cf5db', '0915c522-a36f-40ce-aa0f-2b3181cfeb7e'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:42:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bce87a47-5f4f-458a-b0de-e08ba94e398f tempest-TaggedAttachmentsTest-2065569614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bce87a47-5f4f-458a-b0de-e08ba94e398f tempest-TaggedAttachmentsTest-2065569614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-bce87a47-5f4f-458a-b0de-e08ba94e398f tempest-TaggedAttachmentsTest-2065569614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-bce87a47-5f4f-458a-b0de-e08ba94e398f tempest-TaggedAttachmentsTest-2065569614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bce87a47-5f4f-458a-b0de-e08ba94e398f tempest-TaggedAttachmentsTest-2065569614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bce87a47-5f4f-458a-b0de-e08ba94e398f tempest-TaggedAttachmentsTest-2065569614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:38 devstack sudo[91360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:42:38 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:38 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bce87a47-5f4f-458a-b0de-e08ba94e398f tempest-TaggedAttachmentsTest-2065569614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.385s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:38 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-bce87a47-5f4f-458a-b0de-e08ba94e398f tempest-TaggedAttachmentsTest-2065569614 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:42:38 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-bce87a47-5f4f-458a-b0de-e08ba94e398f tempest-TaggedAttachmentsTest-2065569614 None] Deleted volume successfully. Nov 02 10:42:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bce87a47-5f4f-458a-b0de-e08ba94e398f tempest-TaggedAttachmentsTest-2065569614 None] Lock "cinder-9a64e2a6-8f00-4966-9d03-d4a30532a6ba-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Flow 'volume_create_manager' (ac143bab-203d-4776-abe1-88fc9c83ca80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2dd327-0ef3-42e9-ab21-7d23997f7b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2dd327-0ef3-42e9-ab21-7d23997f7b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1389490097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f4363a-a88f-43a2-af96-b22458079f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd286df42ec439cad53f287af64fd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:47Z,use_quota=True,user_id='674c79438a96441ab9974c2c7106f48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb781d3-21df-43f9-b80c-0c5de7dc393a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb781d3-21df-43f9-b80c-0c5de7dc393a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20829c5-fa25-40f1-aa81-db3e5697125f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20829c5-fa25-40f1-aa81-db3e5697125f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94f4363a-a88f-43a2-af96-b22458079f61', 'volume_name': 'volume-94f4363a-a88f-43a2-af96-b22458079f61', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc505ae8-991f-46c3-a7e8-2b47ca5b77e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc505ae8-991f-46c3-a7e8-2b47ca5b77e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c8695e-84e8-48dc-96d5-165e01c46709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:46 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Volume 94f4363a-a88f-43a2-af96-b22458079f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94f4363a-a88f-43a2-af96-b22458079f61', 'volume_size': 1} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1389490097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f4363a-a88f-43a2-af96-b22458079f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd286df42ec439cad53f287af64fd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:47Z,use_quota=True,user_id='674c79438a96441ab9974c2c7106f48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Creating volume 94f4363a-a88f-43a2-af96-b22458079f61 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:42:46 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:42:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-94f4363a-a88f-43a2-af96-b22458079f61 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:46 devstack sudo[91458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-94f4363a-a88f-43a2-af96-b22458079f61 1073741824 Nov 02 10:42:46 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:47 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-94f4363a-a88f-43a2-af96-b22458079f61 1073741824" returned: 0 in 0.533s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-94f4363a-a88f-43a2-af96-b22458079f61 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:47 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-94f4363a-a88f-43a2-af96-b22458079f61 Nov 02 10:42:47 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:47 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-94f4363a-a88f-43a2-af96-b22458079f61" returned: 0 in 0.292s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:42:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c8695e-84e8-48dc-96d5-165e01c46709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f4363a-a88f-43a2-af96-b22458079f61', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fd11e9-b1ad-48be-baca-7788f76c5d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:47 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Volume volume-94f4363a-a88f-43a2-af96-b22458079f61 (94f4363a-a88f-43a2-af96-b22458079f61): created successfully Nov 02 10:42:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fd11e9-b1ad-48be-baca-7788f76c5d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Flow 'volume_create_manager' (ac143bab-203d-4776-abe1-88fc9c83ca80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b5e6e694-58de-4b61-8156-e3d627297206 tempest-AttachVolumeTestJSON-1499566554 None] Created volume successfully. Nov 02 10:42:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-05b5f80f-cd9d-49bf-89ca-37ab6534fffc req-7e9edb90-c626-47cd-84ce-c4e4a0ce7256 tempest-AttachVolumeTestJSON-1499566554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-05b5f80f-cd9d-49bf-89ca-37ab6534fffc req-7e9edb90-c626-47cd-84ce-c4e4a0ce7256 tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-05b5f80f-cd9d-49bf-89ca-37ab6534fffc req-7e9edb90-c626-47cd-84ce-c4e4a0ce7256 tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-05b5f80f-cd9d-49bf-89ca-37ab6534fffc req-7e9edb90-c626-47cd-84ce-c4e4a0ce7256 tempest-AttachVolumeTestJSON-1499566554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-94f4363a-a88f-43a2-af96-b22458079f61', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c95f516c-26ba-465e-ae0b-0d952c9399cb', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:42:50 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-05b5f80f-cd9d-49bf-89ca-37ab6534fffc req-7e9edb90-c626-47cd-84ce-c4e4a0ce7256 tempest-AttachVolumeTestJSON-1499566554 None] attachment_update completed successfully. Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Flow 'volume_create_manager' (b2c0016e-5764-4479-8340-3d212dbbc172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0114d771-8b64-465b-993b-dff87daf45fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0114d771-8b64-465b-993b-dff87daf45fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1300090939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ec3f82-c0c5-4164-9a0e-e874cf99dee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8e8a8804674eeca9bc771fea721ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:52Z,use_quota=True,user_id='12579413456444e793b56d9534eecf8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ae9fdf-6772-4916-974d-2695d0e06445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ae9fdf-6772-4916-974d-2695d0e06445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1e1132-3fac-4466-8201-5e8006c1c4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1e1132-3fac-4466-8201-5e8006c1c4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2ec3f82-c0c5-4164-9a0e-e874cf99dee4', 'volume_name': 'volume-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90a6042-1275-4231-b204-4c714f56b7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90a6042-1275-4231-b204-4c714f56b7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a9ef44-a6e9-4ef8-b683-7e4f6b4277fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:51 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Volume c2ec3f82-c0c5-4164-9a0e-e874cf99dee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4', 'volume_size': 1} Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1300090939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ec3f82-c0c5-4164-9a0e-e874cf99dee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8e8a8804674eeca9bc771fea721ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:52Z,use_quota=True,user_id='12579413456444e793b56d9534eecf8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Creating volume c2ec3f82-c0c5-4164-9a0e-e874cf99dee4 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:42:51 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:42:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:52 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4 1073741824 Nov 02 10:42:52 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:52 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4 1073741824" returned: 0 in 0.608s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:52 devstack sudo[91912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4 Nov 02 10:42:52 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:53 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:53 devstack sudo[91915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:42:53 devstack sudo[91915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4" returned: 0 in 0.436s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a9ef44-a6e9-4ef8-b683-7e4f6b4277fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd33ce3a-befd-418d-be8f-d453f9c1e789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Flow 'volume_create_manager' (e390aa3f-d1bc-45fe-a5b2-ded67386af27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bfe403b-01c4-440f-9cc7-9e6d14d89f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:53 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Volume volume-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4 (c2ec3f82-c0c5-4164-9a0e-e874cf99dee4): created successfully Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd33ce3a-befd-418d-be8f-d453f9c1e789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Flow 'volume_create_manager' (b2c0016e-5764-4479-8340-3d212dbbc172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bfe403b-01c4-440f-9cc7-9e6d14d89f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1363233657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411d182a-55d1-4dca-9951-47c0d9cfc6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd286df42ec439cad53f287af64fd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:53Z,use_quota=True,user_id='674c79438a96441ab9974c2c7106f48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d259821b-1e32-4d1b-8025-992408d0f3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d259821b-1e32-4d1b-8025-992408d0f3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af17b6c5-c182-46ae-b962-01558e0f7916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af17b6c5-c182-46ae-b962-01558e0f7916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '411d182a-55d1-4dca-9951-47c0d9cfc6bc', 'volume_name': 'volume-411d182a-55d1-4dca-9951-47c0d9cfc6bc', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04f5297b-c874-41ed-99bd-882695ffb262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04f5297b-c874-41ed-99bd-882695ffb262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b343d54e-16da-4bb7-b8f0-c4f3f13fcc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:53 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Volume 411d182a-55d1-4dca-9951-47c0d9cfc6bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-411d182a-55d1-4dca-9951-47c0d9cfc6bc', 'volume_size': 1} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1363233657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411d182a-55d1-4dca-9951-47c0d9cfc6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd286df42ec439cad53f287af64fd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:42:53Z,use_quota=True,user_id='674c79438a96441ab9974c2c7106f48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Creating volume 411d182a-55d1-4dca-9951-47c0d9cfc6bc {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:42:53 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-411d182a-55d1-4dca-9951-47c0d9cfc6bc 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:53 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-10ed5b29-c14a-45d2-9985-923797750093 tempest-AttachVolumeNegativeTest-1125873498 None] Created volume successfully. Nov 02 10:42:53 devstack sudo[91917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-411d182a-55d1-4dca-9951-47c0d9cfc6bc 1073741824 Nov 02 10:42:53 devstack sudo[91917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:53 devstack sudo[91915]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.391s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 8 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:42:53 devstack sudo[91917]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-411d182a-55d1-4dca-9951-47c0d9cfc6bc 1073741824" returned: 0 in 0.577s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-411d182a-55d1-4dca-9951-47c0d9cfc6bc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:53 devstack sudo[91925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-411d182a-55d1-4dca-9951-47c0d9cfc6bc Nov 02 10:42:53 devstack sudo[91925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:54 devstack sudo[91925]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-411d182a-55d1-4dca-9951-47c0d9cfc6bc" returned: 0 in 0.317s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:42:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b343d54e-16da-4bb7-b8f0-c4f3f13fcc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-411d182a-55d1-4dca-9951-47c0d9cfc6bc', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b14f61-0304-431e-96a0-5ead829425a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:42:54 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Volume volume-411d182a-55d1-4dca-9951-47c0d9cfc6bc (411d182a-55d1-4dca-9951-47c0d9cfc6bc): created successfully Nov 02 10:42:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b14f61-0304-431e-96a0-5ead829425a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:42:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Flow 'volume_create_manager' (e390aa3f-d1bc-45fe-a5b2-ded67386af27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:42:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-18167c1b-f506-4c5e-9867-27ad02c31e67 tempest-AttachVolumeTestJSON-1499566554 None] Created volume successfully. Nov 02 10:42:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-19a63ef6-8016-477a-82af-9308e0b3ea0b req-6014edd7-de10-4098-8368-2386ef6adb51 tempest-AttachVolumeNegativeTest-1125873498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-19a63ef6-8016-477a-82af-9308e0b3ea0b req-6014edd7-de10-4098-8368-2386ef6adb51 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-19a63ef6-8016-477a-82af-9308e0b3ea0b req-6014edd7-de10-4098-8368-2386ef6adb51 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-19a63ef6-8016-477a-82af-9308e0b3ea0b req-6014edd7-de10-4098-8368-2386ef6adb51 tempest-AttachVolumeNegativeTest-1125873498 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17e79165-5767-4a76-a034-587187fb4247', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:42:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-19a63ef6-8016-477a-82af-9308e0b3ea0b req-6014edd7-de10-4098-8368-2386ef6adb51 tempest-AttachVolumeNegativeTest-1125873498 None] attachment_update completed successfully. Nov 02 10:42:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-fd18af35-f0ca-4492-aeae-a9945fd2e05a req-7507e86a-66d0-4adc-b957-574daaab2d9b tempest-AttachVolumeTestJSON-1499566554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:42:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-fd18af35-f0ca-4492-aeae-a9945fd2e05a req-7507e86a-66d0-4adc-b957-574daaab2d9b tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:42:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-fd18af35-f0ca-4492-aeae-a9945fd2e05a req-7507e86a-66d0-4adc-b957-574daaab2d9b tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:42:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-fd18af35-f0ca-4492-aeae-a9945fd2e05a req-7507e86a-66d0-4adc-b957-574daaab2d9b tempest-AttachVolumeTestJSON-1499566554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-411d182a-55d1-4dca-9951-47c0d9cfc6bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b15a7ae4-3ef6-479d-940b-736e9ef5e233', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:42:56 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-fd18af35-f0ca-4492-aeae-a9945fd2e05a req-7507e86a-66d0-4adc-b957-574daaab2d9b tempest-AttachVolumeTestJSON-1499566554 None] attachment_update completed successfully. Nov 02 10:42:58 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-2226b733-4a88-4d4a-8fb0-fbe7173d855f req-a73df09d-c493-4be4-bc30-d074450bef93 tempest-AttachVolumeTestJSON-1499566554 None] Terminate volume connection completed successfully. Nov 02 10:42:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-2226b733-4a88-4d4a-8fb0-fbe7173d855f req-a73df09d-c493-4be4-bc30-d074450bef93 tempest-AttachVolumeTestJSON-1499566554 None] Deleting attachment c95f516c-26ba-465e-ae0b-0d952c9399cb. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:42:59 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-dd9994ee-1041-4aef-87ec-bd6bd7d6b901 req-0ef70b0e-85d8-4d6f-bd7a-8b13ab452a63 tempest-AttachVolumeTestJSON-1499566554 None] Terminate volume connection completed successfully. Nov 02 10:42:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-dd9994ee-1041-4aef-87ec-bd6bd7d6b901 req-0ef70b0e-85d8-4d6f-bd7a-8b13ab452a63 tempest-AttachVolumeTestJSON-1499566554 None] Deleting attachment b15a7ae4-3ef6-479d-940b-736e9ef5e233. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:43:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-3f98dc38-6c3e-4d6e-8b28-f0085ba1ff44 req-fde706e0-f8f1-4580-81c7-16debe5651d6 tempest-ServerActionsTestOtherA-509339523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-3f98dc38-6c3e-4d6e-8b28-f0085ba1ff44 req-fde706e0-f8f1-4580-81c7-16debe5651d6 tempest-ServerActionsTestOtherA-509339523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-3f98dc38-6c3e-4d6e-8b28-f0085ba1ff44 req-fde706e0-f8f1-4580-81c7-16debe5651d6 tempest-ServerActionsTestOtherA-509339523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-3f98dc38-6c3e-4d6e-8b28-f0085ba1ff44 req-fde706e0-f8f1-4580-81c7-16debe5651d6 tempest-ServerActionsTestOtherA-509339523 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63341933-d6dc-4a4b-8322-6703394a3bfb', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:43:09 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-3f98dc38-6c3e-4d6e-8b28-f0085ba1ff44 req-fde706e0-f8f1-4580-81c7-16debe5651d6 tempest-ServerActionsTestOtherA-509339523 None] attachment_update completed successfully. Nov 02 10:43:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-71229e91-05e9-4806-9af3-eb393cd2f158 tempest-AttachVolumeTestJSON-1499566554 None] Acquiring lock "cinder-411d182a-55d1-4dca-9951-47c0d9cfc6bc-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-71229e91-05e9-4806-9af3-eb393cd2f158 tempest-AttachVolumeTestJSON-1499566554 None] Lock "cinder-411d182a-55d1-4dca-9951-47c0d9cfc6bc-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-71229e91-05e9-4806-9af3-eb393cd2f158 tempest-AttachVolumeTestJSON-1499566554 None] Acquiring lock "cinder-quobyte-411d182a-55d1-4dca-9951-47c0d9cfc6bc" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-71229e91-05e9-4806-9af3-eb393cd2f158 tempest-AttachVolumeTestJSON-1499566554 None] Lock "cinder-quobyte-411d182a-55d1-4dca-9951-47c0d9cfc6bc" acquired by "delete_volume" :: waited 0.036s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:12 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0798c297-ca9e-4369-924d-7a066df19d78]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-71229e91-05e9-4806-9af3-eb393cd2f158 tempest-AttachVolumeTestJSON-1499566554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-411d182a-55d1-4dca-9951-47c0d9cfc6bc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:12 devstack sudo[92152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-411d182a-55d1-4dca-9951-47c0d9cfc6bc Nov 02 10:43:12 devstack sudo[92152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:13 devstack sudo[92152]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-71229e91-05e9-4806-9af3-eb393cd2f158 tempest-AttachVolumeTestJSON-1499566554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-411d182a-55d1-4dca-9951-47c0d9cfc6bc" returned: 0 in 0.946s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-71229e91-05e9-4806-9af3-eb393cd2f158 tempest-AttachVolumeTestJSON-1499566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-411d182a-55d1-4dca-9951-47c0d9cfc6bc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:13 devstack sudo[92167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-411d182a-55d1-4dca-9951-47c0d9cfc6bc Nov 02 10:43:13 devstack sudo[92167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:13 devstack sudo[92167]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-71229e91-05e9-4806-9af3-eb393cd2f158 tempest-AttachVolumeTestJSON-1499566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-411d182a-55d1-4dca-9951-47c0d9cfc6bc" returned: 0 in 0.685s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-71229e91-05e9-4806-9af3-eb393cd2f158 tempest-AttachVolumeTestJSON-1499566554 None] Lock "cinder-quobyte-411d182a-55d1-4dca-9951-47c0d9cfc6bc" released by "delete_volume" :: held 1.757s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:14 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-71229e91-05e9-4806-9af3-eb393cd2f158 tempest-AttachVolumeTestJSON-1499566554 None] Created reservations ['b9ec38a7-5388-43e9-b347-c6da6ef63825', '2b8b133d-ce83-4028-81ef-0805e84e3904', '0237301f-71cf-4853-a1fc-58f015008990', 'fa0e5f62-a22f-4a0e-a44e-1c2644ee6d78'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-71229e91-05e9-4806-9af3-eb393cd2f158 tempest-AttachVolumeTestJSON-1499566554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-71229e91-05e9-4806-9af3-eb393cd2f158 tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-71229e91-05e9-4806-9af3-eb393cd2f158 tempest-AttachVolumeTestJSON-1499566554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-71229e91-05e9-4806-9af3-eb393cd2f158 tempest-AttachVolumeTestJSON-1499566554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-71229e91-05e9-4806-9af3-eb393cd2f158 tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-71229e91-05e9-4806-9af3-eb393cd2f158 tempest-AttachVolumeTestJSON-1499566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:14 devstack sudo[92174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:43:14 devstack sudo[92174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6eb32fda-1123-454f-b775-b66afe94c97f tempest-AttachVolumeTestJSON-1499566554 None] Acquiring lock "cinder-94f4363a-a88f-43a2-af96-b22458079f61-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6eb32fda-1123-454f-b775-b66afe94c97f tempest-AttachVolumeTestJSON-1499566554 None] Lock "cinder-94f4363a-a88f-43a2-af96-b22458079f61-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6eb32fda-1123-454f-b775-b66afe94c97f tempest-AttachVolumeTestJSON-1499566554 None] Acquiring lock "cinder-quobyte-94f4363a-a88f-43a2-af96-b22458079f61" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6eb32fda-1123-454f-b775-b66afe94c97f tempest-AttachVolumeTestJSON-1499566554 None] Lock "cinder-quobyte-94f4363a-a88f-43a2-af96-b22458079f61" acquired by "delete_volume" :: waited 0.042s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1428462c-69ba-4f06-b1b2-26d94bf16cb7]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6eb32fda-1123-454f-b775-b66afe94c97f tempest-AttachVolumeTestJSON-1499566554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-94f4363a-a88f-43a2-af96-b22458079f61 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:15 devstack sudo[92174]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-71229e91-05e9-4806-9af3-eb393cd2f158 tempest-AttachVolumeTestJSON-1499566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.675s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:15 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-71229e91-05e9-4806-9af3-eb393cd2f158 tempest-AttachVolumeTestJSON-1499566554 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:15 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-71229e91-05e9-4806-9af3-eb393cd2f158 tempest-AttachVolumeTestJSON-1499566554 None] Deleted volume successfully. Nov 02 10:43:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-71229e91-05e9-4806-9af3-eb393cd2f158 tempest-AttachVolumeTestJSON-1499566554 None] Lock "cinder-411d182a-55d1-4dca-9951-47c0d9cfc6bc-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:15 devstack sudo[92192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-94f4363a-a88f-43a2-af96-b22458079f61 Nov 02 10:43:15 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:15 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-d7337360-2099-4ba5-8983-f192d717cf20 req-d2fffa5c-69d8-4557-9f77-bc1225724d01 tempest-ServerActionsTestOtherA-509339523 None] Terminate volume connection completed successfully. Nov 02 10:43:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-d7337360-2099-4ba5-8983-f192d717cf20 req-d2fffa5c-69d8-4557-9f77-bc1225724d01 tempest-ServerActionsTestOtherA-509339523 None] Deleting attachment 63341933-d6dc-4a4b-8322-6703394a3bfb. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:43:15 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6eb32fda-1123-454f-b775-b66afe94c97f tempest-AttachVolumeTestJSON-1499566554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-94f4363a-a88f-43a2-af96-b22458079f61" returned: 0 in 0.718s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6eb32fda-1123-454f-b775-b66afe94c97f tempest-AttachVolumeTestJSON-1499566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-94f4363a-a88f-43a2-af96-b22458079f61 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:15 devstack sudo[92206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-94f4363a-a88f-43a2-af96-b22458079f61 Nov 02 10:43:15 devstack sudo[92206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:16 devstack sudo[92206]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6eb32fda-1123-454f-b775-b66afe94c97f tempest-AttachVolumeTestJSON-1499566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-94f4363a-a88f-43a2-af96-b22458079f61" returned: 0 in 0.639s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6eb32fda-1123-454f-b775-b66afe94c97f tempest-AttachVolumeTestJSON-1499566554 None] Lock "cinder-quobyte-94f4363a-a88f-43a2-af96-b22458079f61" released by "delete_volume" :: held 1.475s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:16 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-6eb32fda-1123-454f-b775-b66afe94c97f tempest-AttachVolumeTestJSON-1499566554 None] Created reservations ['c78c3852-fd4f-4308-810c-26bec72cbdd9', 'b1a5d0ad-e508-4d9a-b65d-747822d2b1da', '2f3cf8b0-2b22-418a-83a5-2e6e3492a895', '2eb20a1f-87bd-4148-b684-de61098c4233'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6eb32fda-1123-454f-b775-b66afe94c97f tempest-AttachVolumeTestJSON-1499566554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6eb32fda-1123-454f-b775-b66afe94c97f tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6eb32fda-1123-454f-b775-b66afe94c97f tempest-AttachVolumeTestJSON-1499566554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6eb32fda-1123-454f-b775-b66afe94c97f tempest-AttachVolumeTestJSON-1499566554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6eb32fda-1123-454f-b775-b66afe94c97f tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6eb32fda-1123-454f-b775-b66afe94c97f tempest-AttachVolumeTestJSON-1499566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:16 devstack sudo[92230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:43:16 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:17 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6eb32fda-1123-454f-b775-b66afe94c97f tempest-AttachVolumeTestJSON-1499566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.592s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:17 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-6eb32fda-1123-454f-b775-b66afe94c97f tempest-AttachVolumeTestJSON-1499566554 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:17 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6eb32fda-1123-454f-b775-b66afe94c97f tempest-AttachVolumeTestJSON-1499566554 None] Deleted volume successfully. Nov 02 10:43:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-d7337360-2099-4ba5-8983-f192d717cf20 req-3619a740-6fdc-4884-b182-c0afa191115d tempest-ServerActionsTestOtherA-509339523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-d7337360-2099-4ba5-8983-f192d717cf20 req-3619a740-6fdc-4884-b182-c0afa191115d tempest-ServerActionsTestOtherA-509339523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6eb32fda-1123-454f-b775-b66afe94c97f tempest-AttachVolumeTestJSON-1499566554 None] Lock "cinder-94f4363a-a88f-43a2-af96-b22458079f61-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-d7337360-2099-4ba5-8983-f192d717cf20 req-3619a740-6fdc-4884-b182-c0afa191115d tempest-ServerActionsTestOtherA-509339523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c64ade1a-6e39-4be6-b1c5-886945dd4e6a tempest-AttachVolumeTestJSON-1499566554 None] Acquiring lock "cinder-c7221a1f-5057-472f-a872-5c7c83a7b5b7-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c64ade1a-6e39-4be6-b1c5-886945dd4e6a tempest-AttachVolumeTestJSON-1499566554 None] Lock "cinder-c7221a1f-5057-472f-a872-5c7c83a7b5b7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-d7337360-2099-4ba5-8983-f192d717cf20 req-3619a740-6fdc-4884-b182-c0afa191115d tempest-ServerActionsTestOtherA-509339523 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e08d9bb-1816-4a17-82c7-76692c8153dc', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:43:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c64ade1a-6e39-4be6-b1c5-886945dd4e6a tempest-AttachVolumeTestJSON-1499566554 None] Acquiring lock "cinder-quobyte-c7221a1f-5057-472f-a872-5c7c83a7b5b7" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c64ade1a-6e39-4be6-b1c5-886945dd4e6a tempest-AttachVolumeTestJSON-1499566554 None] Lock "cinder-quobyte-c7221a1f-5057-472f-a872-5c7c83a7b5b7" acquired by "delete_volume" :: waited 0.034s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:17 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f45688-6b1e-468e-ba99-de65ac637c77]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c64ade1a-6e39-4be6-b1c5-886945dd4e6a tempest-AttachVolumeTestJSON-1499566554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c7221a1f-5057-472f-a872-5c7c83a7b5b7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:17 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-d7337360-2099-4ba5-8983-f192d717cf20 req-3619a740-6fdc-4884-b182-c0afa191115d tempest-ServerActionsTestOtherA-509339523 None] attachment_update completed successfully. Nov 02 10:43:17 devstack sudo[92245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c7221a1f-5057-472f-a872-5c7c83a7b5b7 Nov 02 10:43:17 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:18 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c64ade1a-6e39-4be6-b1c5-886945dd4e6a tempest-AttachVolumeTestJSON-1499566554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c7221a1f-5057-472f-a872-5c7c83a7b5b7" returned: 0 in 0.973s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c64ade1a-6e39-4be6-b1c5-886945dd4e6a tempest-AttachVolumeTestJSON-1499566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c7221a1f-5057-472f-a872-5c7c83a7b5b7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:18 devstack sudo[92255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c7221a1f-5057-472f-a872-5c7c83a7b5b7 Nov 02 10:43:18 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:18 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c64ade1a-6e39-4be6-b1c5-886945dd4e6a tempest-AttachVolumeTestJSON-1499566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c7221a1f-5057-472f-a872-5c7c83a7b5b7" returned: 0 in 0.454s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c64ade1a-6e39-4be6-b1c5-886945dd4e6a tempest-AttachVolumeTestJSON-1499566554 None] Lock "cinder-quobyte-c7221a1f-5057-472f-a872-5c7c83a7b5b7" released by "delete_volume" :: held 1.529s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:19 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c64ade1a-6e39-4be6-b1c5-886945dd4e6a tempest-AttachVolumeTestJSON-1499566554 None] Created reservations ['c421069e-cc56-4605-bc0d-3d6905d501f9', '6a35b297-c508-4598-aa64-cfab084e570b', '88fed56b-3e7b-4d45-a78d-a257ab6c5aed', '4a67bcee-06e4-4554-9005-d74a20491e06'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c64ade1a-6e39-4be6-b1c5-886945dd4e6a tempest-AttachVolumeTestJSON-1499566554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c64ade1a-6e39-4be6-b1c5-886945dd4e6a tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c64ade1a-6e39-4be6-b1c5-886945dd4e6a tempest-AttachVolumeTestJSON-1499566554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c64ade1a-6e39-4be6-b1c5-886945dd4e6a tempest-AttachVolumeTestJSON-1499566554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c64ade1a-6e39-4be6-b1c5-886945dd4e6a tempest-AttachVolumeTestJSON-1499566554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c64ade1a-6e39-4be6-b1c5-886945dd4e6a tempest-AttachVolumeTestJSON-1499566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:19 devstack sudo[92270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:43:19 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:20 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c64ade1a-6e39-4be6-b1c5-886945dd4e6a tempest-AttachVolumeTestJSON-1499566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.819s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:20 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c64ade1a-6e39-4be6-b1c5-886945dd4e6a tempest-AttachVolumeTestJSON-1499566554 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:20 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c64ade1a-6e39-4be6-b1c5-886945dd4e6a tempest-AttachVolumeTestJSON-1499566554 None] Deleted volume successfully. Nov 02 10:43:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c64ade1a-6e39-4be6-b1c5-886945dd4e6a tempest-AttachVolumeTestJSON-1499566554 None] Lock "cinder-c7221a1f-5057-472f-a872-5c7c83a7b5b7-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:29 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=61,cinder:INSERT=11,cinder:UPDATE=46,cinder:DELETE=4 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:43:30 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=52,cinder:SELECT=63,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:43:35 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:43:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Flow 'volume_create_manager' (865478c3-a9d2-4bbe-9152-734d5a288980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (311bd099-1ada-491a-9fac-37228d69510e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (311bd099-1ada-491a-9fac-37228d69510e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2082871056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab6bfdfb90e4950a4466428e53f472f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:36Z,use_quota=True,user_id='5d6d9a4034094df081a328822483a88d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e8d0ed-833e-416e-9805-d448732b511e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e8d0ed-833e-416e-9805-d448732b511e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1dfb80a-6f52-495b-a71a-2730e0e72a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1dfb80a-6f52-495b-a71a-2730e0e72a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5', 'volume_name': 'volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9e69b0-e7f0-4349-9bfb-7335af0ffd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9e69b0-e7f0-4349-9bfb-7335af0ffd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d9eeba-c941-4d90-a65e-6167cdeef2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:36 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Volume 1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5', 'volume_size': 1} Nov 02 10:43:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2082871056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab6bfdfb90e4950a4466428e53f472f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:36Z,use_quota=True,user_id='5d6d9a4034094df081a328822483a88d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:43:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Creating volume 1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:43:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:43:36 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:43:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:36 devstack sudo[92553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5 1073741824 Nov 02 10:43:36 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:36 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5 1073741824" returned: 0 in 0.851s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:37 devstack sudo[92562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5 Nov 02 10:43:37 devstack sudo[92562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:37 devstack sudo[92562]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5" returned: 0 in 0.751s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:43:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d9eeba-c941-4d90-a65e-6167cdeef2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928de996-8b73-4e61-9f1b-b41add6e5310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:37 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Volume volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5 (1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5): created successfully Nov 02 10:43:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928de996-8b73-4e61-9f1b-b41add6e5310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Flow 'volume_create_manager' (865478c3-a9d2-4bbe-9152-734d5a288980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-18d40332-4fa9-4fa3-96fc-a6536130892a req-bf54c136-025c-49f7-84a1-5b00fff3fb25 tempest-VolumesSnapshotsTestJSON-127283400 None] Created volume successfully. Nov 02 10:43:38 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:43:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Flow 'volume_create_manager' (b4db2aa7-4b60-4ad5-a5d7-d033926761a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e190088-0b94-40a8-8415-ae2d3a869f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e190088-0b94-40a8-8415-ae2d3a869f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1391894488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d0031e46794951ac839a2bf03f051b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:38Z,use_quota=True,user_id='d112ab639ae64921945e3077e6301774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f6daf2-c255-4523-9b81-dee0667a1cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f6daf2-c255-4523-9b81-dee0667a1cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143c1c77-05de-4796-8a02-6fdb4a1b3a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143c1c77-05de-4796-8a02-6fdb4a1b3a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f', 'volume_name': 'volume-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca4ec6d-8bfa-414f-b1af-aa76299c7df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca4ec6d-8bfa-414f-b1af-aa76299c7df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e2d248-b195-453c-ae2b-e6e69e135b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Volume fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f', 'volume_size': 1} Nov 02 10:43:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1391894488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d0031e46794951ac839a2bf03f051b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:43:38Z,use_quota=True,user_id='d112ab639ae64921945e3077e6301774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:43:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Creating volume fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:43:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:43:39 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:43:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:39 devstack sudo[92588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f 1073741824 Nov 02 10:43:39 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-36c692ef-1f97-48f7-8510-a384fabca699 req-d7db9d9a-47a7-43fe-9cf3-e30b492d1567 tempest-VolumesSnapshotsTestJSON-127283400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:40 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f 1073741824" returned: 0 in 1.532s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:40 devstack sudo[92632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f Nov 02 10:43:40 devstack sudo[92632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:41 devstack sudo[92632]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f" returned: 0 in 0.347s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:43:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-36c692ef-1f97-48f7-8510-a384fabca699 req-d7db9d9a-47a7-43fe-9cf3-e30b492d1567 tempest-VolumesSnapshotsTestJSON-127283400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.609s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e2d248-b195-453c-ae2b-e6e69e135b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce16046-987c-4d4e-8c68-15661d12ab2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:43:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [req-36c692ef-1f97-48f7-8510-a384fabca699 req-d7db9d9a-47a7-43fe-9cf3-e30b492d1567 tempest-VolumesSnapshotsTestJSON-127283400 None] Creating offline snapshot 49a4cb25-1dbc-4fb9-9401-3bc37b009f5b of volume 1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:43:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Volume volume-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f (fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f): created successfully Nov 02 10:43:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce16046-987c-4d4e-8c68-15661d12ab2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:43:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Flow 'volume_create_manager' (b4db2aa7-4b60-4ad5-a5d7-d033926761a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:43:41 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9817c4f-17c9-460a-b537-580bc95f1fe1]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-36c692ef-1f97-48f7-8510-a384fabca699 req-d7db9d9a-47a7-43fe-9cf3-e30b492d1567 tempest-VolumesSnapshotsTestJSON-127283400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-dcc1e3df-18b9-4a29-8311-2bcd5a9db4ce tempest-ServerRescueNegativeTestJSON-511235222 None] Created volume successfully. Nov 02 10:43:41 devstack sudo[92637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5 Nov 02 10:43:41 devstack sudo[92637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:41 devstack sudo[92637]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-36c692ef-1f97-48f7-8510-a384fabca699 req-d7db9d9a-47a7-43fe-9cf3-e30b492d1567 tempest-VolumesSnapshotsTestJSON-127283400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5" returned: 0 in 0.609s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-36c692ef-1f97-48f7-8510-a384fabca699 req-d7db9d9a-47a7-43fe-9cf3-e30b492d1567 tempest-VolumesSnapshotsTestJSON-127283400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.49a4cb25-1dbc-4fb9-9401-3bc37b009f5b 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:41 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.49a4cb25-1dbc-4fb9-9401-3bc37b009f5b 1G Nov 02 10:43:41 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:42 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-36c692ef-1f97-48f7-8510-a384fabca699 req-d7db9d9a-47a7-43fe-9cf3-e30b492d1567 tempest-VolumesSnapshotsTestJSON-127283400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.49a4cb25-1dbc-4fb9-9401-3bc37b009f5b 1G" returned: 0 in 0.996s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-36c692ef-1f97-48f7-8510-a384fabca699 req-d7db9d9a-47a7-43fe-9cf3-e30b492d1567 tempest-VolumesSnapshotsTestJSON-127283400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.49a4cb25-1dbc-4fb9-9401-3bc37b009f5b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:42 devstack sudo[92650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.49a4cb25-1dbc-4fb9-9401-3bc37b009f5b Nov 02 10:43:42 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:43 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-36c692ef-1f97-48f7-8510-a384fabca699 req-d7db9d9a-47a7-43fe-9cf3-e30b492d1567 tempest-VolumesSnapshotsTestJSON-127283400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.49a4cb25-1dbc-4fb9-9401-3bc37b009f5b" returned: 0 in 0.511s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:43 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [req-36c692ef-1f97-48f7-8510-a384fabca699 req-d7db9d9a-47a7-43fe-9cf3-e30b492d1567 tempest-VolumesSnapshotsTestJSON-127283400 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.49a4cb25-1dbc-4fb9-9401-3bc37b009f5b is being set with open permissions: ugo+rw Nov 02 10:43:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-36c692ef-1f97-48f7-8510-a384fabca699 req-d7db9d9a-47a7-43fe-9cf3-e30b492d1567 tempest-VolumesSnapshotsTestJSON-127283400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.49a4cb25-1dbc-4fb9-9401-3bc37b009f5b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:43 devstack sudo[92656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.49a4cb25-1dbc-4fb9-9401-3bc37b009f5b Nov 02 10:43:43 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:43 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-36c692ef-1f97-48f7-8510-a384fabca699 req-d7db9d9a-47a7-43fe-9cf3-e30b492d1567 tempest-VolumesSnapshotsTestJSON-127283400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.49a4cb25-1dbc-4fb9-9401-3bc37b009f5b" returned: 0 in 0.325s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-36c692ef-1f97-48f7-8510-a384fabca699 req-d7db9d9a-47a7-43fe-9cf3-e30b492d1567 tempest-VolumesSnapshotsTestJSON-127283400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:43 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.info Nov 02 10:43:43 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:44 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-36c692ef-1f97-48f7-8510-a384fabca699 req-d7db9d9a-47a7-43fe-9cf3-e30b492d1567 tempest-VolumesSnapshotsTestJSON-127283400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.info" returned: 0 in 0.383s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:44 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [req-36c692ef-1f97-48f7-8510-a384fabca699 req-d7db9d9a-47a7-43fe-9cf3-e30b492d1567 tempest-VolumesSnapshotsTestJSON-127283400 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.info is being set with open permissions: ugo+rw Nov 02 10:43:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-36c692ef-1f97-48f7-8510-a384fabca699 req-d7db9d9a-47a7-43fe-9cf3-e30b492d1567 tempest-VolumesSnapshotsTestJSON-127283400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:44 devstack sudo[92673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.info Nov 02 10:43:44 devstack sudo[92673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:44 devstack sudo[92673]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-36c692ef-1f97-48f7-8510-a384fabca699 req-d7db9d9a-47a7-43fe-9cf3-e30b492d1567 tempest-VolumesSnapshotsTestJSON-127283400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.info" returned: 0 in 0.331s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-36c692ef-1f97-48f7-8510-a384fabca699 req-d7db9d9a-47a7-43fe-9cf3-e30b492d1567 tempest-VolumesSnapshotsTestJSON-127283400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.533s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-36c692ef-1f97-48f7-8510-a384fabca699 req-d7db9d9a-47a7-43fe-9cf3-e30b492d1567 tempest-VolumesSnapshotsTestJSON-127283400 None] Create snapshot completed successfully Nov 02 10:43:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] Acquiring lock "cinder-49a4cb25-1dbc-4fb9-9401-3bc37b009f5b-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] Lock "cinder-49a4cb25-1dbc-4fb9-9401-3bc37b009f5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] Acquiring lock "cinder-quobyte-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] Lock "cinder-quobyte-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] Acquiring lock "cinder-quobyte-49a4cb25-1dbc-4fb9-9401-3bc37b009f5b" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] Lock "cinder-quobyte-49a4cb25-1dbc-4fb9-9401-3bc37b009f5b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] Deleting offline snapshot 49a4cb25-1dbc-4fb9-9401-3bc37b009f5b of volume 1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:43:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] snapshot_file for this snap is: volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.49a4cb25-1dbc-4fb9-9401-3bc37b009f5b {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:43:44 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9ee28d-cbdb-438b-ad2b-7b41aa297269]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.49a4cb25-1dbc-4fb9-9401-3bc37b009f5b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:45 devstack sudo[92701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.49a4cb25-1dbc-4fb9-9401-3bc37b009f5b Nov 02 10:43:45 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:45 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.49a4cb25-1dbc-4fb9-9401-3bc37b009f5b" returned: 0 in 0.588s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:43:45 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae5a06a-a516-430b-8986-552e0127e7b9]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:45 devstack sudo[92707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5 Nov 02 10:43:45 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-b9f49e6a-8316-463b-a8ee-d5c8faa0cde6 req-55c7d928-fb50-4659-a641-6569ef97fd36 tempest-AttachVolumeNegativeTest-1125873498 None] Terminate volume connection completed successfully. Nov 02 10:43:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-b9f49e6a-8316-463b-a8ee-d5c8faa0cde6 req-55c7d928-fb50-4659-a641-6569ef97fd36 tempest-AttachVolumeNegativeTest-1125873498 None] Deleting attachment 17e79165-5767-4a76-a034-587187fb4247. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:43:46 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5" returned: 0 in 0.491s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.49a4cb25-1dbc-4fb9-9401-3bc37b009f5b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:46 devstack sudo[92715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.49a4cb25-1dbc-4fb9-9401-3bc37b009f5b Nov 02 10:43:46 devstack sudo[92715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:46 devstack sudo[92715]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.49a4cb25-1dbc-4fb9-9401-3bc37b009f5b" returned: 0 in 0.678s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.49a4cb25-1dbc-4fb9-9401-3bc37b009f5b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:46 devstack sudo[92722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.49a4cb25-1dbc-4fb9-9401-3bc37b009f5b Nov 02 10:43:46 devstack sudo[92722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:47 devstack sudo[92722]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5.49a4cb25-1dbc-4fb9-9401-3bc37b009f5b" returned: 0 in 0.664s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] Lock "cinder-quobyte-49a4cb25-1dbc-4fb9-9401-3bc37b009f5b" released by "_delete_snapshot" :: held 2.628s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] Lock "cinder-quobyte-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5" released by "delete_snapshot" :: held 2.684s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:47 devstack cinder-volume[87084]: WARNING cinder.quota [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:43:47 devstack cinder-volume[87084]: DEBUG cinder.quota [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] Created reservations ['e9a5e093-6e61-49da-bf2e-4e9c8c2182d4', 'bfd3d8ab-bf98-4065-9ad2-5f7095ec1b2b', 'cea6e8b1-18aa-4b7e-b71e-1c64e545e70d', '2ccfd184-3df1-4715-8a75-dbcd3dd2730d'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] Delete snapshot completed successfully. Nov 02 10:43:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-b4d36a13-38b2-4337-8907-b17b2742d16f req-3054f4a4-dd04-402e-af42-ee90dccfb3d2 tempest-VolumesSnapshotsTestJSON-127283400 None] Lock "cinder-49a4cb25-1dbc-4fb9-9401-3bc37b009f5b-delete_snapshot" released by "delete_snapshot" :: held 3.331s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-3fb445cd-4b5f-45bf-96a6-a4076e3c38d5 req-f7caeb95-5d0d-45e1-bb54-75b5d65f11c8 tempest-VolumesSnapshotsTestJSON-127283400 None] Acquiring lock "cinder-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-3fb445cd-4b5f-45bf-96a6-a4076e3c38d5 req-f7caeb95-5d0d-45e1-bb54-75b5d65f11c8 tempest-VolumesSnapshotsTestJSON-127283400 None] Lock "cinder-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-3fb445cd-4b5f-45bf-96a6-a4076e3c38d5 req-f7caeb95-5d0d-45e1-bb54-75b5d65f11c8 tempest-VolumesSnapshotsTestJSON-127283400 None] Acquiring lock "cinder-quobyte-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-3fb445cd-4b5f-45bf-96a6-a4076e3c38d5 req-f7caeb95-5d0d-45e1-bb54-75b5d65f11c8 tempest-VolumesSnapshotsTestJSON-127283400 None] Lock "cinder-quobyte-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5" acquired by "delete_volume" :: waited 0.068s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:49 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf97b77-9a9a-4ddc-acc6-a9b28b508288]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-3fb445cd-4b5f-45bf-96a6-a4076e3c38d5 req-f7caeb95-5d0d-45e1-bb54-75b5d65f11c8 tempest-VolumesSnapshotsTestJSON-127283400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:49 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5 Nov 02 10:43:49 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:50 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-3fb445cd-4b5f-45bf-96a6-a4076e3c38d5 req-f7caeb95-5d0d-45e1-bb54-75b5d65f11c8 tempest-VolumesSnapshotsTestJSON-127283400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5" returned: 0 in 1.103s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-3fb445cd-4b5f-45bf-96a6-a4076e3c38d5 req-f7caeb95-5d0d-45e1-bb54-75b5d65f11c8 tempest-VolumesSnapshotsTestJSON-127283400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:50 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5 Nov 02 10:43:50 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:50 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-3fb445cd-4b5f-45bf-96a6-a4076e3c38d5 req-f7caeb95-5d0d-45e1-bb54-75b5d65f11c8 tempest-VolumesSnapshotsTestJSON-127283400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5" returned: 0 in 0.624s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-3fb445cd-4b5f-45bf-96a6-a4076e3c38d5 req-f7caeb95-5d0d-45e1-bb54-75b5d65f11c8 tempest-VolumesSnapshotsTestJSON-127283400 None] Lock "cinder-quobyte-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5" released by "delete_volume" :: held 1.906s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:51 devstack cinder-volume[87084]: DEBUG cinder.quota [req-3fb445cd-4b5f-45bf-96a6-a4076e3c38d5 req-f7caeb95-5d0d-45e1-bb54-75b5d65f11c8 tempest-VolumesSnapshotsTestJSON-127283400 None] Created reservations ['d5bbf75d-56a5-4aeb-ae9d-0af432f1bb19', 'd7bce04f-2f45-4e26-90e4-66dcd3c660ae', '75e4f404-4e26-4079-9e0c-4cc2463f7491', 'bfeea207-53d2-4b41-ab53-51cdc80c1bbc'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-3fb445cd-4b5f-45bf-96a6-a4076e3c38d5 req-f7caeb95-5d0d-45e1-bb54-75b5d65f11c8 tempest-VolumesSnapshotsTestJSON-127283400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-3fb445cd-4b5f-45bf-96a6-a4076e3c38d5 req-f7caeb95-5d0d-45e1-bb54-75b5d65f11c8 tempest-VolumesSnapshotsTestJSON-127283400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-3fb445cd-4b5f-45bf-96a6-a4076e3c38d5 req-f7caeb95-5d0d-45e1-bb54-75b5d65f11c8 tempest-VolumesSnapshotsTestJSON-127283400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-3fb445cd-4b5f-45bf-96a6-a4076e3c38d5 req-f7caeb95-5d0d-45e1-bb54-75b5d65f11c8 tempest-VolumesSnapshotsTestJSON-127283400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-3fb445cd-4b5f-45bf-96a6-a4076e3c38d5 req-f7caeb95-5d0d-45e1-bb54-75b5d65f11c8 tempest-VolumesSnapshotsTestJSON-127283400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-3fb445cd-4b5f-45bf-96a6-a4076e3c38d5 req-f7caeb95-5d0d-45e1-bb54-75b5d65f11c8 tempest-VolumesSnapshotsTestJSON-127283400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:51 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:43:51 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:52 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-3fb445cd-4b5f-45bf-96a6-a4076e3c38d5 req-f7caeb95-5d0d-45e1-bb54-75b5d65f11c8 tempest-VolumesSnapshotsTestJSON-127283400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.733s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:52 devstack cinder-volume[87084]: DEBUG cinder.manager [req-3fb445cd-4b5f-45bf-96a6-a4076e3c38d5 req-f7caeb95-5d0d-45e1-bb54-75b5d65f11c8 tempest-VolumesSnapshotsTestJSON-127283400 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:52 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-3fb445cd-4b5f-45bf-96a6-a4076e3c38d5 req-f7caeb95-5d0d-45e1-bb54-75b5d65f11c8 tempest-VolumesSnapshotsTestJSON-127283400 None] Deleted volume successfully. Nov 02 10:43:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-3fb445cd-4b5f-45bf-96a6-a4076e3c38d5 req-f7caeb95-5d0d-45e1-bb54-75b5d65f11c8 tempest-VolumesSnapshotsTestJSON-127283400 None] Lock "cinder-1db0a7c5-ce8a-4f22-b383-afd95e4cbbd5-delete_volume" released by "delete_volume" :: held 3.224s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:43:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:53 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:43:53 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:53 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.326s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:43:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 8 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:43:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:43:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d911c30-6ef8-4770-995c-86254a72d79e tempest-ServerRescueNegativeTestJSON-511235222 None] Acquiring lock "cinder-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d911c30-6ef8-4770-995c-86254a72d79e tempest-ServerRescueNegativeTestJSON-511235222 None] Lock "cinder-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d911c30-6ef8-4770-995c-86254a72d79e tempest-ServerRescueNegativeTestJSON-511235222 None] Acquiring lock "cinder-quobyte-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:43:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d911c30-6ef8-4770-995c-86254a72d79e tempest-ServerRescueNegativeTestJSON-511235222 None] Lock "cinder-quobyte-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:43:54 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab6879e-b617-49c9-b927-9b53f41f993c]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:43:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d911c30-6ef8-4770-995c-86254a72d79e tempest-ServerRescueNegativeTestJSON-511235222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:54 devstack sudo[92867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f Nov 02 10:43:54 devstack sudo[92867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:54 devstack sudo[92867]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d911c30-6ef8-4770-995c-86254a72d79e tempest-ServerRescueNegativeTestJSON-511235222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f" returned: 0 in 0.407s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d911c30-6ef8-4770-995c-86254a72d79e tempest-ServerRescueNegativeTestJSON-511235222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:55 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f Nov 02 10:43:55 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:55 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d911c30-6ef8-4770-995c-86254a72d79e tempest-ServerRescueNegativeTestJSON-511235222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f" returned: 0 in 0.340s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d911c30-6ef8-4770-995c-86254a72d79e tempest-ServerRescueNegativeTestJSON-511235222 None] Lock "cinder-quobyte-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f" released by "delete_volume" :: held 0.803s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:55 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-6d911c30-6ef8-4770-995c-86254a72d79e tempest-ServerRescueNegativeTestJSON-511235222 None] Created reservations ['3eab41ad-dc5a-42d5-9097-89e539a6a6b7', '098627a5-000e-4f6a-9b33-0495055b6a59', 'fd2eaf75-550b-4c79-b270-cdac4c7e9e15', '6aadc2f5-3db2-4867-8b39-cd7aebacb23d'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:43:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6d911c30-6ef8-4770-995c-86254a72d79e tempest-ServerRescueNegativeTestJSON-511235222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6d911c30-6ef8-4770-995c-86254a72d79e tempest-ServerRescueNegativeTestJSON-511235222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6d911c30-6ef8-4770-995c-86254a72d79e tempest-ServerRescueNegativeTestJSON-511235222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6d911c30-6ef8-4770-995c-86254a72d79e tempest-ServerRescueNegativeTestJSON-511235222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6d911c30-6ef8-4770-995c-86254a72d79e tempest-ServerRescueNegativeTestJSON-511235222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d911c30-6ef8-4770-995c-86254a72d79e tempest-ServerRescueNegativeTestJSON-511235222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:55 devstack sudo[92875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:43:55 devstack sudo[92875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:56 devstack sudo[92875]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d911c30-6ef8-4770-995c-86254a72d79e tempest-ServerRescueNegativeTestJSON-511235222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.462s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:56 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-6d911c30-6ef8-4770-995c-86254a72d79e tempest-ServerRescueNegativeTestJSON-511235222 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:56 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6d911c30-6ef8-4770-995c-86254a72d79e tempest-ServerRescueNegativeTestJSON-511235222 None] Deleted volume successfully. Nov 02 10:43:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d911c30-6ef8-4770-995c-86254a72d79e tempest-ServerRescueNegativeTestJSON-511235222 None] Lock "cinder-fbc6e75a-2fb6-47dc-8aaf-31b3f9e0104f-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:43:59 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2127140c-49fd-4160-b671-92adc01aba4d tempest-GroupsV314Test-722992448 None] Group tempest-GroupsV314Test-Group-99176101: creating Nov 02 10:43:59 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2127140c-49fd-4160-b671-92adc01aba4d tempest-GroupsV314Test-722992448 None] Group tempest-GroupsV314Test-Group-99176101: created successfully Nov 02 10:43:59 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2127140c-49fd-4160-b671-92adc01aba4d tempest-GroupsV314Test-722992448 None] Create group completed successfully. Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Flow 'volume_create_manager' (b67306ba-ad7c-4bb3-8551-a7cfaa11c097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7fae39f-8a65-428d-b2c2-51f0f3823193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7fae39f-8a65-428d-b2c2-51f0f3823193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-987902804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8163f3c1-8921-4df0-a15f-3003032a7599,host='devstack@QuobyteHD#QuobyteHD',id=8158bd6e-8b48-4ee1-931a-8f13898367e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd74cb1574e546248555a4d1f810a19a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:01Z,use_quota=True,user_id='7a6113e124804d40bea27ad3487aa87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fce749a9-3b0c-4546-aea9-ed50ffecfb2e),volume_type_id=fce749a9-3b0c-4546-aea9-ed50ffecfb2e)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540f8d20-68c2-42cd-b4a4-90b15a6f6fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540f8d20-68c2-42cd-b4a4-90b15a6f6fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a99dbe-57ae-4885-8ed5-30cc260fbc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a99dbe-57ae-4885-8ed5-30cc260fbc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8158bd6e-8b48-4ee1-931a-8f13898367e3', 'volume_name': 'volume-8158bd6e-8b48-4ee1-931a-8f13898367e3', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e814a80-d369-4660-8307-98b692bd739b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e814a80-d369-4660-8307-98b692bd739b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4273200e-f129-4e1e-9b1f-89d05e5f55dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:01 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Volume 8158bd6e-8b48-4ee1-931a-8f13898367e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8158bd6e-8b48-4ee1-931a-8f13898367e3', 'volume_size': 1} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8163f3c1-8921-4df0-a15f-3003032a7599,created_at=2026-11-02T09:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-987902804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8163f3c1-8921-4df0-a15f-3003032a7599,host='devstack@QuobyteHD#QuobyteHD',id=8158bd6e-8b48-4ee1-931a-8f13898367e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd74cb1574e546248555a4d1f810a19a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:01Z,use_quota=True,user_id='7a6113e124804d40bea27ad3487aa87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fce749a9-3b0c-4546-aea9-ed50ffecfb2e),volume_type_id=fce749a9-3b0c-4546-aea9-ed50ffecfb2e)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Creating volume 8158bd6e-8b48-4ee1-931a-8f13898367e3 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:01 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:01 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 1073741824 Nov 02 10:44:01 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:01 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 1073741824" returned: 0 in 0.482s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:01 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 Nov 02 10:44:01 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:02 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3" returned: 0 in 0.297s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4273200e-f129-4e1e-9b1f-89d05e5f55dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8158bd6e-8b48-4ee1-931a-8f13898367e3', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f10c3c-5e9b-4d63-b64c-c1b0152ad883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:02 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Volume volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 (8158bd6e-8b48-4ee1-931a-8f13898367e3): created successfully Nov 02 10:44:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f10c3c-5e9b-4d63-b64c-c1b0152ad883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Flow 'volume_create_manager' (b67306ba-ad7c-4bb3-8551-a7cfaa11c097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:02 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-71a07369-c476-41c2-a0fa-3e4b8b06f359 tempest-GroupsV314Test-722992448 None] Created volume successfully. Nov 02 10:44:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:03 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Cloning volume 8158bd6e-8b48-4ee1-931a-8f13898367e3 to volume e7b017f0-710e-4bee-aa1c-e36fdb92b2d7 Nov 02 10:44:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Creating offline snapshot 10e18f5f-efb1-4b91-970a-df2fdc4653f5 of volume 8158bd6e-8b48-4ee1-931a-8f13898367e3 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:44:03 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa46161-55e0-4f7c-bda0-83d5a111827e]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:03 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 Nov 02 10:44:03 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-c241ffc1-8965-4461-9dea-ce1cde67aade req-663f0306-07c1-4647-92e9-610c7f42c1b1 tempest-ServerActionsTestOtherA-509339523 None] Terminate volume connection completed successfully. Nov 02 10:44:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-c241ffc1-8965-4461-9dea-ce1cde67aade req-663f0306-07c1-4647-92e9-610c7f42c1b1 tempest-ServerActionsTestOtherA-509339523 None] Deleting attachment 3e08d9bb-1816-4a17-82c7-76692c8153dc. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:44:04 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3" returned: 0 in 0.682s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:04 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5 1G Nov 02 10:44:04 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:04 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5 1G" returned: 0 in 0.625s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:04 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5 Nov 02 10:44:04 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:05 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5" returned: 0 in 0.495s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:05 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:44:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:05 devstack sudo[93005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5 Nov 02 10:44:05 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:05 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5" returned: 0 in 0.354s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:05 devstack sudo[93015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.info Nov 02 10:44:05 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:06 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.info" returned: 0 in 0.279s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:06 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:44:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:06 devstack sudo[93018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.info Nov 02 10:44:06 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:06 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.info" returned: 0 in 0.258s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Acquiring lock "cinder-quobyte-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Lock "cinder-quobyte-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] snapshot: 10e18f5f-efb1-4b91-970a-df2fdc4653f5, volume: e7b017f0-710e-4bee-aa1c-e36fdb92b2d7, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:44:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:06 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a859577a-481f-429a-86ae-acb16129c744]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:06 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5 Nov 02 10:44:06 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:06 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5" returned: 0 in 0.409s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8158bd6e-8b48-4ee1-931a-8f13898367e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:44:06 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[59edf969-9b3b-4baa-9ec9-81d6980c3f7b]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:07 devstack sudo[93028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 Nov 02 10:44:07 devstack sudo[93028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:07 devstack sudo[93028]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3" returned: 0 in 0.514s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:44:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:44:07 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Path /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7 not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:44:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:07 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7 Nov 02 10:44:07 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:15 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=34,cinder:SELECT=32,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:44:15 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=36,cinder:UPDATE=33,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:44:18 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Flow 'volume_create_manager' (c7556c46-6176-4c59-a57d-c6071fb91bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1922f2ff-6075-46c0-9efc-74b757e64892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1922f2ff-6075-46c0-9efc-74b757e64892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1252430299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=492a74fa-495d-4de2-82df-a30e6ebba35a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc50d90b5b445768a0db86c5766bd8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:18Z,use_quota=True,user_id='10d7477215a64dc2ada2c9fdd2052f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef030a8-940c-46cd-a388-a3402d1c5343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef030a8-940c-46cd-a388-a3402d1c5343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc607c7-5f47-45c2-8d3c-258e1c8a2e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:18 devstack cinder-volume[87084]: DEBUG cinder.image.glance [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Creating Keystone auth plugin from conf {{(pid=87084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:44:19 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7" returned: 0 in 11.909s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:19 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Image conversion details: src /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3, size 1024.00 MB, duration 11.91 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:44:19 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Converted 1024.00 MB image at 85.95 MB/s Nov 02 10:44:19 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:44:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:19 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7 Nov 02 10:44:19 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc607c7-5f47-45c2-8d3c-258e1c8a2e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '492a74fa-495d-4de2-82df-a30e6ebba35a', 'volume_name': 'volume-492a74fa-495d-4de2-82df-a30e6ebba35a', 'volume_size': 1, 'image_id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9af457eb3c6844a99ee880354ae43eac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'created_at': datetime.datetime(2026, 11, 2, 9, 33, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0223-61d3-44de-a27f-c6e0b6ba1310/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd11e6bb-5d78-4d97-9ce9-a37bdc732d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd11e6bb-5d78-4d97-9ce9-a37bdc732d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f45fb8-6d48-41f6-b2e6-1e05acf9906c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:19 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Volume 492a74fa-495d-4de2-82df-a30e6ebba35a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-492a74fa-495d-4de2-82df-a30e6ebba35a', 'volume_size': 1, 'image_id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9af457eb3c6844a99ee880354ae43eac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'created_at': datetime.datetime(2026, 11, 2, 9, 33, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0223-61d3-44de-a27f-c6e0b6ba1310/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:44:19 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Trying to clone 492a74fa-495d-4de2-82df-a30e6ebba35a from image 918d0223-61d3-44de-a27f-c6e0b6ba1310 at location (None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}]). {{(pid=87084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:44:19 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7" returned: 0 in 0.454s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Lock "cinder-quobyte-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7" released by "_copy_volume_from_snapshot" :: held 13.412s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Acquiring lock "cinder-quobyte-10e18f5f-efb1-4b91-970a-df2fdc4653f5" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Lock "cinder-quobyte-10e18f5f-efb1-4b91-970a-df2fdc4653f5" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Deleting offline snapshot 10e18f5f-efb1-4b91-970a-df2fdc4653f5 of volume 8158bd6e-8b48-4ee1-931a-8f13898367e3 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:44:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] snapshot_file for this snap is: volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:44:19 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9905934f-cdbe-421f-8355-26c4f90ef6fc]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:20 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_fxcidwlrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:44:20 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:44:20 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5 Nov 02 10:44:20 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:20 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae119cf8-dd61-4aca-9ef3-28c6ac7a3a82]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_fxcidwlrdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:20 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_fxcidwlrdevstack@QuobyteHD Nov 02 10:44:20 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:20 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5" returned: 0 in 0.525s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8158bd6e-8b48-4ee1-931a-8f13898367e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:44:20 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19c1788-c925-4e2a-b9eb-dd0e1324c972]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:20 devstack sudo[93167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 Nov 02 10:44:20 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:20 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_fxcidwlrdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:20 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Temporary image 918d0223-61d3-44de-a27f-c6e0b6ba1310 is fetched for user 10d7477215a64dc2ada2c9fdd2052f25. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:44:20 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d75178-6bb4-45da-87b1-f9dce704b4de]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_fxcidwlrdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:21 devstack sudo[93174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_fxcidwlrdevstack@QuobyteHD Nov 02 10:44:21 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:21 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3" returned: 0 in 0.670s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:21 devstack sudo[93180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5 Nov 02 10:44:21 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:21 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_fxcidwlrdevstack@QuobyteHD" returned: 0 in 0.554s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:21 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5" returned: 0 in 0.435s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:21 devstack sudo[93189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5 Nov 02 10:44:21 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:21 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3.10e18f5f-efb1-4b91-970a-df2fdc4653f5" returned: 0 in 0.349s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Lock "cinder-quobyte-10e18f5f-efb1-4b91-970a-df2fdc4653f5" released by "_delete_snapshot" :: held 2.137s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.577s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.612s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1252430299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=492a74fa-495d-4de2-82df-a30e6ebba35a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc50d90b5b445768a0db86c5766bd8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:18Z,use_quota=True,user_id='10d7477215a64dc2ada2c9fdd2052f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Creating volume 492a74fa-495d-4de2-82df-a30e6ebba35a {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:22 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:44:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-492a74fa-495d-4de2-82df-a30e6ebba35a 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:22 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-492a74fa-495d-4de2-82df-a30e6ebba35a 1073741824 Nov 02 10:44:22 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:22 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a132cb95-a6bb-42cb-80f3-67558fdfc8cc tempest-GroupsV314Test-722992448 None] Create group from source-group-8163f3c1-8921-4df0-a15f-3003032a7599 completed successfully. Nov 02 10:44:22 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-492a74fa-495d-4de2-82df-a30e6ebba35a 1073741824" returned: 0 in 0.561s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-492a74fa-495d-4de2-82df-a30e6ebba35a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:22 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-492a74fa-495d-4de2-82df-a30e6ebba35a Nov 02 10:44:22 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:23 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-492a74fa-495d-4de2-82df-a30e6ebba35a" returned: 0 in 0.398s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:23 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Attempting download of 918d0223-61d3-44de-a27f-c6e0b6ba1310 ((None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}])) to volume 492a74fa-495d-4de2-82df-a30e6ebba35a. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:44:23 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6c4369-6c40-4267-9cf9-a17eb1037656]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_bpdhpjr7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:23 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_bpdhpjr7 Nov 02 10:44:23 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:23 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_bpdhpjr7" returned: 0 in 0.523s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_bpdhpjr7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:23 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_bpdhpjr7 Nov 02 10:44:23 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-384584b3-798c-4795-b0fa-dc6d6b6d5c8e tempest-GroupsV314Test-722992448 None] Acquiring lock "cinder-quobyte-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-384584b3-798c-4795-b0fa-dc6d6b6d5c8e tempest-GroupsV314Test-722992448 None] Lock "cinder-quobyte-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6c2982-8c38-4960-a919-8ada1abd487d]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-384584b3-798c-4795-b0fa-dc6d6b6d5c8e tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:24 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_bpdhpjr7" returned: 1 in 0.436s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_bpdhpjr7' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:44:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01de3ff-0b15-4170-bcb9-4a3ce605f012]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_fxcidwlrdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:24 devstack sudo[93269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7 Nov 02 10:44:24 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:24 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_fxcidwlrdevstack@QuobyteHD Nov 02 10:44:24 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:24 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_fxcidwlrdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:24 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] 918d0223-61d3-44de-a27f-c6e0b6ba1310 was qcow2, converting to qcow2 {{(pid=87084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:44:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_fxcidwlrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-492a74fa-495d-4de2-82df-a30e6ebba35a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:24 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-384584b3-798c-4795-b0fa-dc6d6b6d5c8e tempest-GroupsV314Test-722992448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7" returned: 0 in 0.488s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-384584b3-798c-4795-b0fa-dc6d6b6d5c8e tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:24 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_fxcidwlrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-492a74fa-495d-4de2-82df-a30e6ebba35a Nov 02 10:44:24 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:24 devstack sudo[93283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7 Nov 02 10:44:24 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:24 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-384584b3-798c-4795-b0fa-dc6d6b6d5c8e tempest-GroupsV314Test-722992448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7" returned: 0 in 0.248s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-384584b3-798c-4795-b0fa-dc6d6b6d5c8e tempest-GroupsV314Test-722992448 None] Lock "cinder-quobyte-e7b017f0-710e-4bee-aa1c-e36fdb92b2d7" released by "delete_volume" :: held 0.804s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:24 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-384584b3-798c-4795-b0fa-dc6d6b6d5c8e tempest-GroupsV314Test-722992448 None] Created reservations ['230fb84b-c2e5-44cb-95b2-134e8ef4e999'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:24 devstack cinder-volume[87084]: WARNING cinder.quota [None req-384584b3-798c-4795-b0fa-dc6d6b6d5c8e tempest-GroupsV314Test-722992448 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1859039388 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1859039388, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:44:24 devstack cinder-volume[87084]: WARNING cinder.quota [None req-384584b3-798c-4795-b0fa-dc6d6b6d5c8e tempest-GroupsV314Test-722992448 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1859039388 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1859039388, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:44:24 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-384584b3-798c-4795-b0fa-dc6d6b6d5c8e tempest-GroupsV314Test-722992448 None] Created reservations ['844b07aa-ec96-42e0-8257-c16490491149', '4e058f00-ba65-437d-9f63-876f4829cc7d', '69303662-eec4-419b-b352-93b439f2ab6c', '94256280-982d-4070-9fd4-da17ecc05385'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-384584b3-798c-4795-b0fa-dc6d6b6d5c8e tempest-GroupsV314Test-722992448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-384584b3-798c-4795-b0fa-dc6d6b6d5c8e tempest-GroupsV314Test-722992448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-384584b3-798c-4795-b0fa-dc6d6b6d5c8e tempest-GroupsV314Test-722992448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-384584b3-798c-4795-b0fa-dc6d6b6d5c8e tempest-GroupsV314Test-722992448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-384584b3-798c-4795-b0fa-dc6d6b6d5c8e tempest-GroupsV314Test-722992448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-384584b3-798c-4795-b0fa-dc6d6b6d5c8e tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0e43e24e-04c1-4016-8309-8a53a0a2ec96 tempest-BackendsCapabilitiesAdminTestsJSON-1796007258 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8580207824707, 'free_capacity_gb': 1773.8580207824707, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87084) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 10:44:25 devstack sudo[93291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:44:25 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d8faf6be-70cb-41b4-aaaa-1475a081add0 tempest-BackendsCapabilitiesAdminTestsJSON-1796007258 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8580207824707, 'free_capacity_gb': 1773.8580207824707, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87084) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 10:44:25 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-384584b3-798c-4795-b0fa-dc6d6b6d5c8e tempest-GroupsV314Test-722992448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.282s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:25 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-384584b3-798c-4795-b0fa-dc6d6b6d5c8e tempest-GroupsV314Test-722992448 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:25 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-384584b3-798c-4795-b0fa-dc6d6b6d5c8e tempest-GroupsV314Test-722992448 None] Delete group completed successfully. Nov 02 10:44:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-58973c74-b43a-44d9-b550-5b3c4c942296 tempest-GroupsV314Test-722992448 None] Acquiring lock "cinder-quobyte-8158bd6e-8b48-4ee1-931a-8f13898367e3" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-58973c74-b43a-44d9-b550-5b3c4c942296 tempest-GroupsV314Test-722992448 None] Lock "cinder-quobyte-8158bd6e-8b48-4ee1-931a-8f13898367e3" acquired by "delete_volume" :: waited 0.034s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:25 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3a75c3-95fd-4416-b9a1-cab3ae4f35bd]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-58973c74-b43a-44d9-b550-5b3c4c942296 tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:25 devstack sudo[93298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 Nov 02 10:44:25 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:26 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-58973c74-b43a-44d9-b550-5b3c4c942296 tempest-GroupsV314Test-722992448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3" returned: 0 in 0.425s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-58973c74-b43a-44d9-b550-5b3c4c942296 tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:26 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3 Nov 02 10:44:26 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:26 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-58973c74-b43a-44d9-b550-5b3c4c942296 tempest-GroupsV314Test-722992448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8158bd6e-8b48-4ee1-931a-8f13898367e3" returned: 0 in 0.277s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-58973c74-b43a-44d9-b550-5b3c4c942296 tempest-GroupsV314Test-722992448 None] Lock "cinder-quobyte-8158bd6e-8b48-4ee1-931a-8f13898367e3" released by "delete_volume" :: held 0.851s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:26 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-58973c74-b43a-44d9-b550-5b3c4c942296 tempest-GroupsV314Test-722992448 None] Created reservations ['03be9895-8893-46b5-84f6-88fe1ef58532'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:26 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-58973c74-b43a-44d9-b550-5b3c4c942296 tempest-GroupsV314Test-722992448 None] Created reservations ['efb3b757-7bac-4864-a349-639862ca75d9', '25705237-b466-461c-87f3-e96aea51eaa2', 'faceda78-b77d-4265-87cb-d99005dd2794', '35d1c176-20f1-49d2-a09c-44a5760a5438'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-58973c74-b43a-44d9-b550-5b3c4c942296 tempest-GroupsV314Test-722992448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-58973c74-b43a-44d9-b550-5b3c4c942296 tempest-GroupsV314Test-722992448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-58973c74-b43a-44d9-b550-5b3c4c942296 tempest-GroupsV314Test-722992448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-58973c74-b43a-44d9-b550-5b3c4c942296 tempest-GroupsV314Test-722992448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-58973c74-b43a-44d9-b550-5b3c4c942296 tempest-GroupsV314Test-722992448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-58973c74-b43a-44d9-b550-5b3c4c942296 tempest-GroupsV314Test-722992448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:26 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:44:26 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:27 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_fxcidwlrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-492a74fa-495d-4de2-82df-a30e6ebba35a" returned: 0 in 2.571s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:27 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_fxcidwlrdevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-492a74fa-495d-4de2-82df-a30e6ebba35a {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:44:27 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Converted 112.00 MB image at 43.53 MB/s Nov 02 10:44:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-492a74fa-495d-4de2-82df-a30e6ebba35a 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:27 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-58973c74-b43a-44d9-b550-5b3c4c942296 tempest-GroupsV314Test-722992448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.409s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:27 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-58973c74-b43a-44d9-b550-5b3c4c942296 tempest-GroupsV314Test-722992448 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:27 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-58973c74-b43a-44d9-b550-5b3c4c942296 tempest-GroupsV314Test-722992448 None] Delete group completed successfully. Nov 02 10:44:27 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-492a74fa-495d-4de2-82df-a30e6ebba35a 1G Nov 02 10:44:27 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:27 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-492a74fa-495d-4de2-82df-a30e6ebba35a 1G" returned: 0 in 0.414s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:27 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Downloaded image 918d0223-61d3-44de-a27f-c6e0b6ba1310 ((None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}])) to volume 492a74fa-495d-4de2-82df-a30e6ebba35a successfully. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:44:27 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Temporary image 918d0223-61d3-44de-a27f-c6e0b6ba1310 for user 10d7477215a64dc2ada2c9fdd2052f25 is deleted. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:44:27 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Marking volume 492a74fa-495d-4de2-82df-a30e6ebba35a as bootable. {{(pid=87084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:44:27 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Copying metadata from image 918d0223-61d3-44de-a27f-c6e0b6ba1310 to 492a74fa-495d-4de2-82df-a30e6ebba35a. {{(pid=87084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:44:27 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Creating volume glance metadata for volume 492a74fa-495d-4de2-82df-a30e6ebba35a backed by image 918d0223-61d3-44de-a27f-c6e0b6ba1310 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:44:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f45fb8-6d48-41f6-b2e6-1e05acf9906c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-492a74fa-495d-4de2-82df-a30e6ebba35a', 'volume_size': 1, 'image_id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9af457eb3c6844a99ee880354ae43eac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'created_at': datetime.datetime(2026, 11, 2, 9, 33, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0223-61d3-44de-a27f-c6e0b6ba1310/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7257f80-8a9c-4d3e-8530-13223bfd2ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:27 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Volume volume-492a74fa-495d-4de2-82df-a30e6ebba35a (492a74fa-495d-4de2-82df-a30e6ebba35a): created successfully Nov 02 10:44:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7257f80-8a9c-4d3e-8530-13223bfd2ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Flow 'volume_create_manager' (c7556c46-6176-4c59-a57d-c6071fb91bff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:27 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-348fc071-785b-40f2-a642-5a1ad883b85d tempest-ServerActionsTestOtherA-509339523 None] Created volume successfully. Nov 02 10:44:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-ee747a62-aa4b-49af-8a46-2719b5a0f494 req-d34677ca-fc6b-4808-9114-141076cbd0a1 tempest-ServerActionsTestOtherA-509339523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-ee747a62-aa4b-49af-8a46-2719b5a0f494 req-d34677ca-fc6b-4808-9114-141076cbd0a1 tempest-ServerActionsTestOtherA-509339523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-ee747a62-aa4b-49af-8a46-2719b5a0f494 req-d34677ca-fc6b-4808-9114-141076cbd0a1 tempest-ServerActionsTestOtherA-509339523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-ee747a62-aa4b-49af-8a46-2719b5a0f494 req-d34677ca-fc6b-4808-9114-141076cbd0a1 tempest-ServerActionsTestOtherA-509339523 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-492a74fa-495d-4de2-82df-a30e6ebba35a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da2cb75b-ac2e-44b6-b013-9a8c35aed928', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:44:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-ee747a62-aa4b-49af-8a46-2719b5a0f494 req-d34677ca-fc6b-4808-9114-141076cbd0a1 tempest-ServerActionsTestOtherA-509339523 None] attachment_update completed successfully. Nov 02 10:44:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5cc87a38-6e9e-4b42-8b2b-52aa1582d780 tempest-GroupsTest-1903702392 None] Group tempest-Group1-809041443: creating Nov 02 10:44:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5cc87a38-6e9e-4b42-8b2b-52aa1582d780 tempest-GroupsTest-1903702392 None] Group tempest-Group1-809041443: created successfully Nov 02 10:44:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5cc87a38-6e9e-4b42-8b2b-52aa1582d780 tempest-GroupsTest-1903702392 None] Create group completed successfully. Nov 02 10:44:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-062b0459-1ae2-4d04-9efd-e196f245309f tempest-GroupsTest-1903702392 None] Group tempest-Group2-31409510: creating Nov 02 10:44:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-062b0459-1ae2-4d04-9efd-e196f245309f tempest-GroupsTest-1903702392 None] Group tempest-Group2-31409510: created successfully Nov 02 10:44:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-062b0459-1ae2-4d04-9efd-e196f245309f tempest-GroupsTest-1903702392 None] Create group completed successfully. Nov 02 10:44:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5d790c07-c89b-43e8-9b31-730b1d98315f tempest-GroupsV320Test-1709878913 None] Group tempest-GroupsV320Test-Group-1181091542: creating Nov 02 10:44:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5d790c07-c89b-43e8-9b31-730b1d98315f tempest-GroupsV320Test-1709878913 None] Group tempest-GroupsV320Test-Group-1181091542: created successfully Nov 02 10:44:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5d790c07-c89b-43e8-9b31-730b1d98315f tempest-GroupsV320Test-1709878913 None] Create group completed successfully. Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Flow 'volume_create_manager' (3c69171a-e38c-4f4e-adb6-8c26cfec5382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145fbbac-ad90-44a9-b7f4-6799b0e578cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145fbbac-ad90-44a9-b7f4-6799b0e578cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1372831659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=af10c5b1-be60-4b0e-b3f9-3493b9549bff,host='devstack@QuobyteHD#QuobyteHD',id=d7a64510-5a90-46c4-8b5b-04f9bb5879f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1faa3473ad6a4c7493f34ceffa00f954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:36Z,use_quota=True,user_id='c9b6f1fa46ba4fc58b86a8cd643a06c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d21c29b-4d7d-450b-ba38-55e416abe3e5),volume_type_id=4d21c29b-4d7d-450b-ba38-55e416abe3e5)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4240a7-6057-43a9-9579-d3186c6c4392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4240a7-6057-43a9-9579-d3186c6c4392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b0dfab-626b-4a15-8053-ddc9d09830cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b0dfab-626b-4a15-8053-ddc9d09830cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a64510-5a90-46c4-8b5b-04f9bb5879f8', 'volume_name': 'volume-d7a64510-5a90-46c4-8b5b-04f9bb5879f8', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4ee22e-fb8c-48b7-b646-f6db008f0193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4ee22e-fb8c-48b7-b646-f6db008f0193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2542bbf-914e-4503-9473-d446ea12c3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:36 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Volume d7a64510-5a90-46c4-8b5b-04f9bb5879f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a64510-5a90-46c4-8b5b-04f9bb5879f8', 'volume_size': 1} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=af10c5b1-be60-4b0e-b3f9-3493b9549bff,created_at=2026-11-02T09:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1372831659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=af10c5b1-be60-4b0e-b3f9-3493b9549bff,host='devstack@QuobyteHD#QuobyteHD',id=d7a64510-5a90-46c4-8b5b-04f9bb5879f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1faa3473ad6a4c7493f34ceffa00f954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:36Z,use_quota=True,user_id='c9b6f1fa46ba4fc58b86a8cd643a06c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d21c29b-4d7d-450b-ba38-55e416abe3e5),volume_type_id=4d21c29b-4d7d-450b-ba38-55e416abe3e5)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Creating volume d7a64510-5a90-46c4-8b5b-04f9bb5879f8 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:36 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7a64510-5a90-46c4-8b5b-04f9bb5879f8 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:36 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7a64510-5a90-46c4-8b5b-04f9bb5879f8 1073741824 Nov 02 10:44:36 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c0e62c76-6b3f-46a3-97bc-66aee49a5150 tempest-GroupsV320Test-1709878913 None] Created reservations ['c3fabf6a-32b2-47f0-a503-64bca7e9c685'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c0e62c76-6b3f-46a3-97bc-66aee49a5150 tempest-GroupsV320Test-1709878913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c0e62c76-6b3f-46a3-97bc-66aee49a5150 tempest-GroupsV320Test-1709878913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c0e62c76-6b3f-46a3-97bc-66aee49a5150 tempest-GroupsV320Test-1709878913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c0e62c76-6b3f-46a3-97bc-66aee49a5150 tempest-GroupsV320Test-1709878913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c0e62c76-6b3f-46a3-97bc-66aee49a5150 tempest-GroupsV320Test-1709878913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0e62c76-6b3f-46a3-97bc-66aee49a5150 tempest-GroupsV320Test-1709878913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:36 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:44:36 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:37 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0e62c76-6b3f-46a3-97bc-66aee49a5150 tempest-GroupsV320Test-1709878913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.426s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:37 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c0e62c76-6b3f-46a3-97bc-66aee49a5150 tempest-GroupsV320Test-1709878913 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c0e62c76-6b3f-46a3-97bc-66aee49a5150 tempest-GroupsV320Test-1709878913 None] Delete group completed successfully. Nov 02 10:44:37 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7a64510-5a90-46c4-8b5b-04f9bb5879f8 1073741824" returned: 0 in 0.656s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7a64510-5a90-46c4-8b5b-04f9bb5879f8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:37 devstack sudo[93795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7a64510-5a90-46c4-8b5b-04f9bb5879f8 Nov 02 10:44:37 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:37 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7a64510-5a90-46c4-8b5b-04f9bb5879f8" returned: 0 in 0.369s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2542bbf-914e-4503-9473-d446ea12c3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a64510-5a90-46c4-8b5b-04f9bb5879f8', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22320100-996a-4825-bdd7-2d68712ac9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:37 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Volume volume-d7a64510-5a90-46c4-8b5b-04f9bb5879f8 (d7a64510-5a90-46c4-8b5b-04f9bb5879f8): created successfully Nov 02 10:44:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22320100-996a-4825-bdd7-2d68712ac9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Flow 'volume_create_manager' (3c69171a-e38c-4f4e-adb6-8c26cfec5382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-79162b01-dfd7-4626-8a45-0018a1ce6934 tempest-GroupsTest-1903702392 None] Created volume successfully. Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Flow 'volume_create_manager' (b30a1d0f-92be-44ee-a85e-298ecd6858e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74223344-5e60-414e-8c89-f8fffc96707d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74223344-5e60-414e-8c89-f8fffc96707d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-622102110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9571fb7-1097-4ed2-a55a-cbfd6fe15b39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8e8a8804674eeca9bc771fea721ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:38Z,use_quota=True,user_id='12579413456444e793b56d9534eecf8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eafbf49-8b24-4cd0-b5cc-ecf2ebeb4607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eafbf49-8b24-4cd0-b5cc-ecf2ebeb4607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765afa4d-662e-457f-9e3d-3c5b50116d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765afa4d-662e-457f-9e3d-3c5b50116d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9571fb7-1097-4ed2-a55a-cbfd6fe15b39', 'volume_name': 'volume-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be3fcc5-7867-4345-be05-3fcec830996e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be3fcc5-7867-4345-be05-3fcec830996e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147ddd1e-ca14-417e-85f3-b3ed962564a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:38 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Volume b9571fb7-1097-4ed2-a55a-cbfd6fe15b39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39', 'volume_size': 1} Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-622102110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9571fb7-1097-4ed2-a55a-cbfd6fe15b39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8e8a8804674eeca9bc771fea721ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:38Z,use_quota=True,user_id='12579413456444e793b56d9534eecf8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Creating volume b9571fb7-1097-4ed2-a55a-cbfd6fe15b39 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:38 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:44:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:38 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39 1073741824 Nov 02 10:44:38 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:39 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39 1073741824" returned: 0 in 0.724s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:39 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39 Nov 02 10:44:39 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:39 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39" returned: 0 in 0.428s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147ddd1e-ca14-417e-85f3-b3ed962564a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa91ff1-dca4-419a-a373-875f1391d2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Volume volume-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39 (b9571fb7-1097-4ed2-a55a-cbfd6fe15b39): created successfully Nov 02 10:44:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa91ff1-dca4-419a-a373-875f1391d2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Flow 'volume_create_manager' (b30a1d0f-92be-44ee-a85e-298ecd6858e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:39 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-fd45c37d-4726-4aec-af70-e1486690f32c tempest-AttachVolumeNegativeTest-1125873498 None] Created volume successfully. Nov 02 10:44:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-09e55c3e-2895-4157-8382-4bc37d92a55e tempest-GroupsTest-1903702392 None] Acquiring lock "cinder-quobyte-d7a64510-5a90-46c4-8b5b-04f9bb5879f8" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-09e55c3e-2895-4157-8382-4bc37d92a55e tempest-GroupsTest-1903702392 None] Lock "cinder-quobyte-d7a64510-5a90-46c4-8b5b-04f9bb5879f8" acquired by "delete_volume" :: waited 0.048s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:41 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1412cf22-836c-4685-bfa7-c1ee7d0e66f8]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-09e55c3e-2895-4157-8382-4bc37d92a55e tempest-GroupsTest-1903702392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7a64510-5a90-46c4-8b5b-04f9bb5879f8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:41 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7a64510-5a90-46c4-8b5b-04f9bb5879f8 Nov 02 10:44:41 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:41 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-09e55c3e-2895-4157-8382-4bc37d92a55e tempest-GroupsTest-1903702392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7a64510-5a90-46c4-8b5b-04f9bb5879f8" returned: 0 in 0.827s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-09e55c3e-2895-4157-8382-4bc37d92a55e tempest-GroupsTest-1903702392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7a64510-5a90-46c4-8b5b-04f9bb5879f8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:42 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7a64510-5a90-46c4-8b5b-04f9bb5879f8 Nov 02 10:44:42 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-3ec244f8-38ff-4049-bfb0-07c8c7ee0219 req-280411f4-9a09-40e4-ac7a-a40a76217585 tempest-AttachVolumeNegativeTest-1125873498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-3ec244f8-38ff-4049-bfb0-07c8c7ee0219 req-280411f4-9a09-40e4-ac7a-a40a76217585 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-3ec244f8-38ff-4049-bfb0-07c8c7ee0219 req-280411f4-9a09-40e4-ac7a-a40a76217585 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-3ec244f8-38ff-4049-bfb0-07c8c7ee0219 req-280411f4-9a09-40e4-ac7a-a40a76217585 tempest-AttachVolumeNegativeTest-1125873498 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33cbd4c8-2d94-4a08-86b7-da87218214ef', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:44:42 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-09e55c3e-2895-4157-8382-4bc37d92a55e tempest-GroupsTest-1903702392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7a64510-5a90-46c4-8b5b-04f9bb5879f8" returned: 0 in 0.663s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-09e55c3e-2895-4157-8382-4bc37d92a55e tempest-GroupsTest-1903702392 None] Lock "cinder-quobyte-d7a64510-5a90-46c4-8b5b-04f9bb5879f8" released by "delete_volume" :: held 1.587s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:44:42 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-3ec244f8-38ff-4049-bfb0-07c8c7ee0219 req-280411f4-9a09-40e4-ac7a-a40a76217585 tempest-AttachVolumeNegativeTest-1125873498 None] attachment_update completed successfully. Nov 02 10:44:42 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-09e55c3e-2895-4157-8382-4bc37d92a55e tempest-GroupsTest-1903702392 None] Created reservations ['9e8a94ac-bef4-475c-abfd-bae2368cf1f9'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:42 devstack cinder-volume[87084]: WARNING cinder.quota [None req-09e55c3e-2895-4157-8382-4bc37d92a55e tempest-GroupsTest-1903702392 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1899610406 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1899610406, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:44:42 devstack cinder-volume[87084]: WARNING cinder.quota [None req-09e55c3e-2895-4157-8382-4bc37d92a55e tempest-GroupsTest-1903702392 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1899610406 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1899610406, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:44:42 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-09e55c3e-2895-4157-8382-4bc37d92a55e tempest-GroupsTest-1903702392 None] Created reservations ['41cc0faf-f96b-486a-ab2a-20884ee99e9d', 'e388f396-d3c6-4c59-a461-e27dd0bd7a29', 'c9325a67-bda6-4270-bb2f-5de05a6b1e7d', 'bc45238e-2add-4fb5-96e6-220ef26406e6'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-09e55c3e-2895-4157-8382-4bc37d92a55e tempest-GroupsTest-1903702392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-09e55c3e-2895-4157-8382-4bc37d92a55e tempest-GroupsTest-1903702392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-09e55c3e-2895-4157-8382-4bc37d92a55e tempest-GroupsTest-1903702392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-09e55c3e-2895-4157-8382-4bc37d92a55e tempest-GroupsTest-1903702392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-09e55c3e-2895-4157-8382-4bc37d92a55e tempest-GroupsTest-1903702392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-09e55c3e-2895-4157-8382-4bc37d92a55e tempest-GroupsTest-1903702392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:43 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:44:43 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:43 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-09e55c3e-2895-4157-8382-4bc37d92a55e tempest-GroupsTest-1903702392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.614s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:43 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-09e55c3e-2895-4157-8382-4bc37d92a55e tempest-GroupsTest-1903702392 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-09e55c3e-2895-4157-8382-4bc37d92a55e tempest-GroupsTest-1903702392 None] Delete group completed successfully. Nov 02 10:44:44 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-0223d1fe-6022-470b-8cad-4881bcf91098 tempest-GroupsTest-1903702392 None] Created reservations ['aa4dfcea-1812-4f2a-8d1f-bf559876370a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:44:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0223d1fe-6022-470b-8cad-4881bcf91098 tempest-GroupsTest-1903702392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0223d1fe-6022-470b-8cad-4881bcf91098 tempest-GroupsTest-1903702392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0223d1fe-6022-470b-8cad-4881bcf91098 tempest-GroupsTest-1903702392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0223d1fe-6022-470b-8cad-4881bcf91098 tempest-GroupsTest-1903702392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0223d1fe-6022-470b-8cad-4881bcf91098 tempest-GroupsTest-1903702392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0223d1fe-6022-470b-8cad-4881bcf91098 tempest-GroupsTest-1903702392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:44 devstack sudo[93840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:44:44 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:44 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0223d1fe-6022-470b-8cad-4881bcf91098 tempest-GroupsTest-1903702392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.495s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:44 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-0223d1fe-6022-470b-8cad-4881bcf91098 tempest-GroupsTest-1903702392 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0223d1fe-6022-470b-8cad-4881bcf91098 tempest-GroupsTest-1903702392 None] Delete group completed successfully. Nov 02 10:44:46 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5a946fad-61b0-47f5-9bf0-eb9af9f1b085 tempest-GroupsTest-1903702392 None] Group tempest-GroupsTest-Group-1566395044: creating Nov 02 10:44:46 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5a946fad-61b0-47f5-9bf0-eb9af9f1b085 tempest-GroupsTest-1903702392 None] Group tempest-GroupsTest-Group-1566395044: created successfully Nov 02 10:44:46 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-462941cf-631f-4ea3-bad5-81215247bd40 req-daa4ce36-036c-4ad8-85dd-f06544908c73 tempest-AttachVolumeNegativeTest-1125873498 None] Terminate volume connection completed successfully. Nov 02 10:44:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-462941cf-631f-4ea3-bad5-81215247bd40 req-daa4ce36-036c-4ad8-85dd-f06544908c73 tempest-AttachVolumeNegativeTest-1125873498 None] Deleting attachment 33cbd4c8-2d94-4a08-86b7-da87218214ef. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:44:46 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5a946fad-61b0-47f5-9bf0-eb9af9f1b085 tempest-GroupsTest-1903702392 None] Create group completed successfully. Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Flow 'volume_create_manager' (a9624d04-5174-48a5-b931-89e3994865b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d6df98-766e-4156-9bcf-201a0a9c9b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d6df98-766e-4156-9bcf-201a0a9c9b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1564205904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4b1efc4-2a45-44f6-8065-0a8fa49e25ca,host='devstack@QuobyteHD#QuobyteHD',id=4f1ad2fc-2b0a-4244-ae34-c934a643c373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1faa3473ad6a4c7493f34ceffa00f954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:49Z,use_quota=True,user_id='c9b6f1fa46ba4fc58b86a8cd643a06c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad44d3a2-0fd2-455d-903b-fa2c5dde3d4b),volume_type_id=ad44d3a2-0fd2-455d-903b-fa2c5dde3d4b)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6af0e21-434a-4f01-9eb1-7e2600491f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6af0e21-434a-4f01-9eb1-7e2600491f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872f7514-748a-4e30-a773-7b458173877e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872f7514-748a-4e30-a773-7b458173877e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f1ad2fc-2b0a-4244-ae34-c934a643c373', 'volume_name': 'volume-4f1ad2fc-2b0a-4244-ae34-c934a643c373', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98d3b14-fc52-45ad-abb2-451003e55bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98d3b14-fc52-45ad-abb2-451003e55bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279c8027-82df-4b3b-a12c-e5ccfe62864c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:49 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Volume 4f1ad2fc-2b0a-4244-ae34-c934a643c373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f1ad2fc-2b0a-4244-ae34-c934a643c373', 'volume_size': 1} Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e4b1efc4-2a45-44f6-8065-0a8fa49e25ca,created_at=2026-11-02T09:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1564205904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4b1efc4-2a45-44f6-8065-0a8fa49e25ca,host='devstack@QuobyteHD#QuobyteHD',id=4f1ad2fc-2b0a-4244-ae34-c934a643c373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1faa3473ad6a4c7493f34ceffa00f954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:49Z,use_quota=True,user_id='c9b6f1fa46ba4fc58b86a8cd643a06c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad44d3a2-0fd2-455d-903b-fa2c5dde3d4b),volume_type_id=ad44d3a2-0fd2-455d-903b-fa2c5dde3d4b)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Creating volume 4f1ad2fc-2b0a-4244-ae34-c934a643c373 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:49 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:44:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f1ad2fc-2b0a-4244-ae34-c934a643c373 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:49 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f1ad2fc-2b0a-4244-ae34-c934a643c373 1073741824 Nov 02 10:44:49 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:50 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f1ad2fc-2b0a-4244-ae34-c934a643c373 1073741824" returned: 0 in 1.323s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f1ad2fc-2b0a-4244-ae34-c934a643c373 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:51 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f1ad2fc-2b0a-4244-ae34-c934a643c373 Nov 02 10:44:51 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:51 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f1ad2fc-2b0a-4244-ae34-c934a643c373" returned: 0 in 0.773s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] <== create_volume: return (2224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.237s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279c8027-82df-4b3b-a12c-e5ccfe62864c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f1ad2fc-2b0a-4244-ae34-c934a643c373', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc368e54-0a85-45d4-af81-ae210fe67f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:51 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Volume volume-4f1ad2fc-2b0a-4244-ae34-c934a643c373 (4f1ad2fc-2b0a-4244-ae34-c934a643c373): created successfully Nov 02 10:44:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc368e54-0a85-45d4-af81-ae210fe67f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Flow 'volume_create_manager' (a9624d04-5174-48a5-b931-89e3994865b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:51 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1d4d1805-89c7-4390-b498-1e23f618c213 tempest-GroupsTest-1903702392 None] Created volume successfully. Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Flow 'volume_create_manager' (2178a44b-f98e-4b17-962e-28a264284a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc8f435-7b1d-46ab-9876-5fc7607a907f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc8f435-7b1d-46ab-9876-5fc7607a907f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-851033784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87917f98-81c0-443b-93c1-d16fe13e59a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='815ca7a3c8ad4ca3ba5d7ac48942f39c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:52Z,use_quota=True,user_id='76fed7972248457ea01ddffa4471672b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2d2ac2-3395-44ef-8e80-99343c175128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2d2ac2-3395-44ef-8e80-99343c175128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ce814d-25b4-4942-82d4-9d95306087bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ce814d-25b4-4942-82d4-9d95306087bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87917f98-81c0-443b-93c1-d16fe13e59a1', 'volume_name': 'volume-87917f98-81c0-443b-93c1-d16fe13e59a1', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fac7889-5ae4-46ec-8d0d-e6e9ed795ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fac7889-5ae4-46ec-8d0d-e6e9ed795ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334c19de-3407-4624-9f84-81fa5b72d78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:52 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Volume 87917f98-81c0-443b-93c1-d16fe13e59a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87917f98-81c0-443b-93c1-d16fe13e59a1', 'volume_size': 1} Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-851033784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87917f98-81c0-443b-93c1-d16fe13e59a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='815ca7a3c8ad4ca3ba5d7ac48942f39c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:52Z,use_quota=True,user_id='76fed7972248457ea01ddffa4471672b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Creating volume 87917f98-81c0-443b-93c1-d16fe13e59a1 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:52 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:52 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1 1073741824 Nov 02 10:44:52 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:52 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-e45f16d1-c247-4da9-af8d-fd8977338cba req-aa37fc06-0d61-4c37-999c-2b4dd4016be1 tempest-ServerActionsTestOtherA-509339523 None] Terminate volume connection completed successfully. Nov 02 10:44:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-e45f16d1-c247-4da9-af8d-fd8977338cba req-aa37fc06-0d61-4c37-999c-2b4dd4016be1 tempest-ServerActionsTestOtherA-509339523 None] Deleting attachment da2cb75b-ac2e-44b6-b013-9a8c35aed928. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:53 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:44:53 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:53 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Flow 'volume_create_manager' (852673bf-8d4f-49f6-b1a0-06ef54a7d722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a32088-a44f-401a-9a4d-3a138ccf8173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1 1073741824" returned: 0 in 1.094s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a32088-a44f-401a-9a4d-3a138ccf8173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1035161724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4b1efc4-2a45-44f6-8065-0a8fa49e25ca,host='devstack@QuobyteHD#QuobyteHD',id=4ae804ef-f3e3-4714-ba74-22d0b6b06bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1faa3473ad6a4c7493f34ceffa00f954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:53Z,use_quota=True,user_id='c9b6f1fa46ba4fc58b86a8cd643a06c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad44d3a2-0fd2-455d-903b-fa2c5dde3d4b),volume_type_id=ad44d3a2-0fd2-455d-903b-fa2c5dde3d4b)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1826db-b9f5-41fe-9f95-0fc5d42a5ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1826db-b9f5-41fe-9f95-0fc5d42a5ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23688a12-ec23-4063-8bed-3245541a706e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23688a12-ec23-4063-8bed-3245541a706e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ae804ef-f3e3-4714-ba74-22d0b6b06bc4', 'volume_name': 'volume-4ae804ef-f3e3-4714-ba74-22d0b6b06bc4', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a5c4296-d012-46a7-a3a0-690a8c9ab4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a5c4296-d012-46a7-a3a0-690a8c9ab4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8822c568-c75d-4d17-a5f4-b6e8bbe0a323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:53 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Volume 4ae804ef-f3e3-4714-ba74-22d0b6b06bc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ae804ef-f3e3-4714-ba74-22d0b6b06bc4', 'volume_size': 1} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:53 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1 Nov 02 10:44:53 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:53 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.455s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:44:53 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1" returned: 0 in 0.286s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.332s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e4b1efc4-2a45-44f6-8065-0a8fa49e25ca,created_at=2026-11-02T09:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1035161724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4b1efc4-2a45-44f6-8065-0a8fa49e25ca,host='devstack@QuobyteHD#QuobyteHD',id=4ae804ef-f3e3-4714-ba74-22d0b6b06bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1faa3473ad6a4c7493f34ceffa00f954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:53Z,use_quota=True,user_id='c9b6f1fa46ba4fc58b86a8cd643a06c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad44d3a2-0fd2-455d-903b-fa2c5dde3d4b),volume_type_id=ad44d3a2-0fd2-455d-903b-fa2c5dde3d4b)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Creating volume 4ae804ef-f3e3-4714-ba74-22d0b6b06bc4 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:53 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4ae804ef-f3e3-4714-ba74-22d0b6b06bc4 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:53 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4ae804ef-f3e3-4714-ba74-22d0b6b06bc4 1073741824 Nov 02 10:44:53 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334c19de-3407-4624-9f84-81fa5b72d78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87917f98-81c0-443b-93c1-d16fe13e59a1', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e825f49-dbaf-45b1-a741-302feaa9dc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:53 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Volume volume-87917f98-81c0-443b-93c1-d16fe13e59a1 (87917f98-81c0-443b-93c1-d16fe13e59a1): created successfully Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e825f49-dbaf-45b1-a741-302feaa9dc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Flow 'volume_create_manager' (2178a44b-f98e-4b17-962e-28a264284a1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:53 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-53d93856-9fe3-44f0-aa54-055e020016a0 tempest-SnapshotsActionsTest-2110103102 None] Created volume successfully. Nov 02 10:44:54 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4ae804ef-f3e3-4714-ba74-22d0b6b06bc4 1073741824" returned: 0 in 0.558s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4ae804ef-f3e3-4714-ba74-22d0b6b06bc4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:54 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4ae804ef-f3e3-4714-ba74-22d0b6b06bc4 Nov 02 10:44:54 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-069aefd5-b254-43fd-b468-de7ce435cb48 tempest-SnapshotsActionsTest-2110103102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:54 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4ae804ef-f3e3-4714-ba74-22d0b6b06bc4" returned: 0 in 0.393s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:44:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-069aefd5-b254-43fd-b468-de7ce435cb48 tempest-SnapshotsActionsTest-2110103102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.168s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-069aefd5-b254-43fd-b468-de7ce435cb48 tempest-SnapshotsActionsTest-2110103102 None] Creating offline snapshot cea179c3-d4e2-4b91-9d35-0ce69187cf19 of volume 87917f98-81c0-443b-93c1-d16fe13e59a1 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:44:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8822c568-c75d-4d17-a5f4-b6e8bbe0a323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae804ef-f3e3-4714-ba74-22d0b6b06bc4', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8c5077-8c7e-468b-965b-93d51e394e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:54 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Volume volume-4ae804ef-f3e3-4714-ba74-22d0b6b06bc4 (4ae804ef-f3e3-4714-ba74-22d0b6b06bc4): created successfully Nov 02 10:44:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8c5077-8c7e-468b-965b-93d51e394e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Flow 'volume_create_manager' (852673bf-8d4f-49f6-b1a0-06ef54a7d722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:54 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8871b7-1725-4088-9dd4-6e122a86853c]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-069aefd5-b254-43fd-b468-de7ce435cb48 tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1c052d21-fc8e-44b9-9cea-c71e01a59767 tempest-GroupsTest-1903702392 None] Created volume successfully. Nov 02 10:44:54 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1 Nov 02 10:44:54 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-e45f16d1-c247-4da9-af8d-fd8977338cba req-38906552-c20d-4635-bedc-c5c45096156b tempest-ServerActionsTestOtherA-509339523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:55 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-069aefd5-b254-43fd-b468-de7ce435cb48 tempest-SnapshotsActionsTest-2110103102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1" returned: 0 in 0.429s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-069aefd5-b254-43fd-b468-de7ce435cb48 tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:55 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 1G Nov 02 10:44:55 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:55 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-069aefd5-b254-43fd-b468-de7ce435cb48 tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 1G" returned: 0 in 0.491s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-069aefd5-b254-43fd-b468-de7ce435cb48 tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87917f98-81c0-443b-93c1-d16fe13e59a1 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:55 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87917f98-81c0-443b-93c1-d16fe13e59a1 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 Nov 02 10:44:55 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:55 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-daeaf673-e677-413e-bf08-bf71c6a844ac tempest-GroupsTest-1903702392 None] Update group completed successfully. Nov 02 10:44:56 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-069aefd5-b254-43fd-b468-de7ce435cb48 tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87917f98-81c0-443b-93c1-d16fe13e59a1 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19" returned: 0 in 0.394s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:56 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-069aefd5-b254-43fd-b468-de7ce435cb48 tempest-SnapshotsActionsTest-2110103102 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 is being set with open permissions: ugo+rw Nov 02 10:44:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-069aefd5-b254-43fd-b468-de7ce435cb48 tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:56 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 Nov 02 10:44:56 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:56 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-069aefd5-b254-43fd-b468-de7ce435cb48 tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19" returned: 0 in 0.285s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-069aefd5-b254-43fd-b468-de7ce435cb48 tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:56 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.info Nov 02 10:44:56 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:56 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-069aefd5-b254-43fd-b468-de7ce435cb48 tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.info" returned: 0 in 0.307s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:56 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-069aefd5-b254-43fd-b468-de7ce435cb48 tempest-SnapshotsActionsTest-2110103102 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.info is being set with open permissions: ugo+rw Nov 02 10:44:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-069aefd5-b254-43fd-b468-de7ce435cb48 tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:56 devstack sudo[93999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.info Nov 02 10:44:56 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:57 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-069aefd5-b254-43fd-b468-de7ce435cb48 tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.info" returned: 0 in 0.271s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-069aefd5-b254-43fd-b468-de7ce435cb48 tempest-SnapshotsActionsTest-2110103102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.331s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-e45f16d1-c247-4da9-af8d-fd8977338cba req-38906552-c20d-4635-bedc-c5c45096156b tempest-ServerActionsTestOtherA-509339523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-e45f16d1-c247-4da9-af8d-fd8977338cba req-38906552-c20d-4635-bedc-c5c45096156b tempest-ServerActionsTestOtherA-509339523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-069aefd5-b254-43fd-b468-de7ce435cb48 tempest-SnapshotsActionsTest-2110103102 None] Create snapshot completed successfully Nov 02 10:44:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-e45f16d1-c247-4da9-af8d-fd8977338cba req-38906552-c20d-4635-bedc-c5c45096156b tempest-ServerActionsTestOtherA-509339523 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-492a74fa-495d-4de2-82df-a30e6ebba35a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9274053c-e82f-47ce-b310-43834e1fd5b2', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:44:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-e45f16d1-c247-4da9-af8d-fd8977338cba req-38906552-c20d-4635-bedc-c5c45096156b tempest-ServerActionsTestOtherA-509339523 None] attachment_update completed successfully. Nov 02 10:44:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-60e2c0de-06f7-41cd-98dd-ee6f60f61382 tempest-GroupsTest-1903702392 None] Update group completed successfully. Nov 02 10:44:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0b1e87fc-3c93-42aa-8fa6-494e86b41f87 tempest-SnapshotsActionsTest-2110103102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0b1e87fc-3c93-42aa-8fa6-494e86b41f87 tempest-SnapshotsActionsTest-2110103102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-0b1e87fc-3c93-42aa-8fa6-494e86b41f87 tempest-SnapshotsActionsTest-2110103102 None] Creating offline snapshot 33b4f368-63a3-4837-819e-0fc22a41f756 of volume 87917f98-81c0-443b-93c1-d16fe13e59a1 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:44:59 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc57bd7-49f4-4e49-a74d-cb0b3122d352]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b1e87fc-3c93-42aa-8fa6-494e86b41f87 tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:59 devstack sudo[94457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 Nov 02 10:44:59 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Acquiring lock "cinder-quobyte-4ae804ef-f3e3-4714-ba74-22d0b6b06bc4" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:44:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Lock "cinder-quobyte-4ae804ef-f3e3-4714-ba74-22d0b6b06bc4" acquired by "delete_volume" :: waited 0.036s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:44:59 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3941a1-fb64-4550-b61f-d37555ec1cfd]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:44:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4ae804ef-f3e3-4714-ba74-22d0b6b06bc4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:59 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b1e87fc-3c93-42aa-8fa6-494e86b41f87 tempest-SnapshotsActionsTest-2110103102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19" returned: 0 in 0.644s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-0b1e87fc-3c93-42aa-8fa6-494e86b41f87 tempest-SnapshotsActionsTest-2110103102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87917f98-81c0-443b-93c1-d16fe13e59a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:44:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b1e87fc-3c93-42aa-8fa6-494e86b41f87 tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.33b4f368-63a3-4837-819e-0fc22a41f756 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:59 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4ae804ef-f3e3-4714-ba74-22d0b6b06bc4 Nov 02 10:44:59 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:59 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.33b4f368-63a3-4837-819e-0fc22a41f756 1G Nov 02 10:44:59 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:00 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4ae804ef-f3e3-4714-ba74-22d0b6b06bc4" returned: 0 in 0.659s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4ae804ef-f3e3-4714-ba74-22d0b6b06bc4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:00 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4ae804ef-f3e3-4714-ba74-22d0b6b06bc4 Nov 02 10:45:00 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:00 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b1e87fc-3c93-42aa-8fa6-494e86b41f87 tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.33b4f368-63a3-4837-819e-0fc22a41f756 1G" returned: 0 in 0.825s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b1e87fc-3c93-42aa-8fa6-494e86b41f87 tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.33b4f368-63a3-4837-819e-0fc22a41f756 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:00 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.33b4f368-63a3-4837-819e-0fc22a41f756 Nov 02 10:45:00 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:00 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4ae804ef-f3e3-4714-ba74-22d0b6b06bc4" returned: 0 in 0.526s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Lock "cinder-quobyte-4ae804ef-f3e3-4714-ba74-22d0b6b06bc4" released by "delete_volume" :: held 1.292s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Acquiring lock "cinder-quobyte-4f1ad2fc-2b0a-4244-ae34-c934a643c373" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Lock "cinder-quobyte-4f1ad2fc-2b0a-4244-ae34-c934a643c373" acquired by "delete_volume" :: waited 0.057s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:00 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f32c222-3375-4e49-bad5-f98071262d28]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f1ad2fc-2b0a-4244-ae34-c934a643c373 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:01 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b1e87fc-3c93-42aa-8fa6-494e86b41f87 tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.33b4f368-63a3-4837-819e-0fc22a41f756" returned: 0 in 0.564s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:01 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-0b1e87fc-3c93-42aa-8fa6-494e86b41f87 tempest-SnapshotsActionsTest-2110103102 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.33b4f368-63a3-4837-819e-0fc22a41f756 is being set with open permissions: ugo+rw Nov 02 10:45:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b1e87fc-3c93-42aa-8fa6-494e86b41f87 tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.33b4f368-63a3-4837-819e-0fc22a41f756 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:01 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.33b4f368-63a3-4837-819e-0fc22a41f756 Nov 02 10:45:01 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:01 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f1ad2fc-2b0a-4244-ae34-c934a643c373 Nov 02 10:45:01 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:01 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b1e87fc-3c93-42aa-8fa6-494e86b41f87 tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.33b4f368-63a3-4837-819e-0fc22a41f756" returned: 0 in 0.419s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0b1e87fc-3c93-42aa-8fa6-494e86b41f87 tempest-SnapshotsActionsTest-2110103102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.661s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:01 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0b1e87fc-3c93-42aa-8fa6-494e86b41f87 tempest-SnapshotsActionsTest-2110103102 None] Create snapshot completed successfully Nov 02 10:45:01 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f1ad2fc-2b0a-4244-ae34-c934a643c373" returned: 0 in 0.942s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f1ad2fc-2b0a-4244-ae34-c934a643c373 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:01 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f1ad2fc-2b0a-4244-ae34-c934a643c373 Nov 02 10:45:01 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] Acquiring lock "cinder-33b4f368-63a3-4837-819e-0fc22a41f756-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-33b4f368-63a3-4837-819e-0fc22a41f756-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] Acquiring lock "cinder-quobyte-87917f98-81c0-443b-93c1-d16fe13e59a1" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-quobyte-87917f98-81c0-443b-93c1-d16fe13e59a1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] Acquiring lock "cinder-quobyte-33b4f368-63a3-4837-819e-0fc22a41f756" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:02 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f1ad2fc-2b0a-4244-ae34-c934a643c373" returned: 0 in 0.600s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-quobyte-33b4f368-63a3-4837-819e-0fc22a41f756" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] Deleting offline snapshot 33b4f368-63a3-4837-819e-0fc22a41f756 of volume 87917f98-81c0-443b-93c1-d16fe13e59a1 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:45:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] snapshot_file for this snap is: volume-87917f98-81c0-443b-93c1-d16fe13e59a1.33b4f368-63a3-4837-819e-0fc22a41f756 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:45:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Lock "cinder-quobyte-4f1ad2fc-2b0a-4244-ae34-c934a643c373" released by "delete_volume" :: held 1.719s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:02 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d80b7cd-8db5-4e95-bc47-99824548b2d6]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.33b4f368-63a3-4837-819e-0fc22a41f756 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:02 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Created reservations ['b702b0fc-e1b2-490a-b95c-53804c662c9a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:02 devstack cinder-volume[87084]: WARNING cinder.quota [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-196974008 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-196974008, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:45:02 devstack cinder-volume[87084]: WARNING cinder.quota [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-196974008 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-196974008, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:45:02 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.33b4f368-63a3-4837-819e-0fc22a41f756 Nov 02 10:45:02 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:02 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Created reservations ['bbcf6625-5271-43fc-8c3f-f446ef490de7', 'fedfd52b-d0f0-4cc9-a42f-8af1007a934b', '1d1c7f28-6380-4088-97fc-e3ddebc56d5b', '29d4f41f-ebd0-4e72-ba2a-2156438e1930'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:03 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Created reservations ['26322db0-34dc-483a-8899-189427e5c653', 'e6cb6be9-e0f5-40f7-8907-8d05558bd8e9', '7d0f99cf-0ef0-4e6e-a135-015fe6698ed5', '6dc4188b-916a-40f5-bae4-e485a2b40eae'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:03 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.33b4f368-63a3-4837-819e-0fc22a41f756" returned: 0 in 0.827s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87917f98-81c0-443b-93c1-d16fe13e59a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:45:03 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:45:03 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:03 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81d8b81-4899-4236-a6b3-a1f22298e2a3]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:03 devstack sudo[94529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 Nov 02 10:45:03 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:03 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.481s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:03 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b589008c-36ee-4a6a-a527-fe076f60f446 tempest-GroupsTest-1903702392 None] Delete group completed successfully. Nov 02 10:45:04 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19" returned: 0 in 0.721s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87917f98-81c0-443b-93c1-d16fe13e59a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:45:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.33b4f368-63a3-4837-819e-0fc22a41f756 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:04 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.33b4f368-63a3-4837-819e-0fc22a41f756 Nov 02 10:45:04 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:05 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.33b4f368-63a3-4837-819e-0fc22a41f756" returned: 0 in 1.006s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.33b4f368-63a3-4837-819e-0fc22a41f756 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:05 devstack sudo[94541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.33b4f368-63a3-4837-819e-0fc22a41f756 Nov 02 10:45:05 devstack sudo[94541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:05 devstack sudo[94541]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.33b4f368-63a3-4837-819e-0fc22a41f756" returned: 0 in 0.587s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-quobyte-33b4f368-63a3-4837-819e-0fc22a41f756" released by "_delete_snapshot" :: held 3.408s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-quobyte-87917f98-81c0-443b-93c1-d16fe13e59a1" released by "delete_snapshot" :: held 3.461s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:06 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] Created reservations ['e4e7058b-ab28-46e4-be49-078bed82cb68', '2248484b-4185-4e8e-a16d-da750cb25fd6', '9ace816b-cafe-474d-b741-365eead2dd91', '2954143e-a7e7-4965-aaa3-3fc3738cdbae'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:06 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] Delete snapshot completed successfully. Nov 02 10:45:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ae4c728b-d5f9-49fe-8073-8a36cb6aedd8 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-33b4f368-63a3-4837-819e-0fc22a41f756-delete_snapshot" released by "delete_snapshot" :: held 3.755s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c2265429-c9ed-43f2-b19a-b079f38977be tempest-SnapshotsActionsTest-2110103102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c2265429-c9ed-43f2-b19a-b079f38977be tempest-SnapshotsActionsTest-2110103102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c2265429-c9ed-43f2-b19a-b079f38977be tempest-SnapshotsActionsTest-2110103102 None] Creating offline snapshot 93e61d1d-a505-49b9-a8b1-96a1fd7bce10 of volume 87917f98-81c0-443b-93c1-d16fe13e59a1 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:45:08 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b520f9-73b6-40b5-9523-56991ac08be3]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2265429-c9ed-43f2-b19a-b079f38977be tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:08 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 Nov 02 10:45:08 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:09 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2265429-c9ed-43f2-b19a-b079f38977be tempest-SnapshotsActionsTest-2110103102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19" returned: 0 in 0.837s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c2265429-c9ed-43f2-b19a-b079f38977be tempest-SnapshotsActionsTest-2110103102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87917f98-81c0-443b-93c1-d16fe13e59a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:45:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2265429-c9ed-43f2-b19a-b079f38977be tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.93e61d1d-a505-49b9-a8b1-96a1fd7bce10 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:09 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.93e61d1d-a505-49b9-a8b1-96a1fd7bce10 1G Nov 02 10:45:09 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:10 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2265429-c9ed-43f2-b19a-b079f38977be tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.93e61d1d-a505-49b9-a8b1-96a1fd7bce10 1G" returned: 0 in 0.936s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2265429-c9ed-43f2-b19a-b079f38977be tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.93e61d1d-a505-49b9-a8b1-96a1fd7bce10 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:10 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.93e61d1d-a505-49b9-a8b1-96a1fd7bce10 Nov 02 10:45:10 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:11 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2265429-c9ed-43f2-b19a-b079f38977be tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.93e61d1d-a505-49b9-a8b1-96a1fd7bce10" returned: 0 in 0.870s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:11 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-c2265429-c9ed-43f2-b19a-b079f38977be tempest-SnapshotsActionsTest-2110103102 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.93e61d1d-a505-49b9-a8b1-96a1fd7bce10 is being set with open permissions: ugo+rw Nov 02 10:45:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2265429-c9ed-43f2-b19a-b079f38977be tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.93e61d1d-a505-49b9-a8b1-96a1fd7bce10 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:11 devstack sudo[94632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.93e61d1d-a505-49b9-a8b1-96a1fd7bce10 Nov 02 10:45:11 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:11 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2265429-c9ed-43f2-b19a-b079f38977be tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.93e61d1d-a505-49b9-a8b1-96a1fd7bce10" returned: 0 in 0.538s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c2265429-c9ed-43f2-b19a-b079f38977be tempest-SnapshotsActionsTest-2110103102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.555s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:11 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c2265429-c9ed-43f2-b19a-b079f38977be tempest-SnapshotsActionsTest-2110103102 None] Create snapshot completed successfully Nov 02 10:45:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] Acquiring lock "cinder-93e61d1d-a505-49b9-a8b1-96a1fd7bce10-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-93e61d1d-a505-49b9-a8b1-96a1fd7bce10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] Acquiring lock "cinder-quobyte-87917f98-81c0-443b-93c1-d16fe13e59a1" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-quobyte-87917f98-81c0-443b-93c1-d16fe13e59a1" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] Acquiring lock "cinder-quobyte-93e61d1d-a505-49b9-a8b1-96a1fd7bce10" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-quobyte-93e61d1d-a505-49b9-a8b1-96a1fd7bce10" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] Deleting offline snapshot 93e61d1d-a505-49b9-a8b1-96a1fd7bce10 of volume 87917f98-81c0-443b-93c1-d16fe13e59a1 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:45:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] snapshot_file for this snap is: volume-87917f98-81c0-443b-93c1-d16fe13e59a1.93e61d1d-a505-49b9-a8b1-96a1fd7bce10 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:45:12 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe5194f-5a74-465a-b148-c09eec8d995e]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.93e61d1d-a505-49b9-a8b1-96a1fd7bce10 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:12 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.93e61d1d-a505-49b9-a8b1-96a1fd7bce10 Nov 02 10:45:12 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:13 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.93e61d1d-a505-49b9-a8b1-96a1fd7bce10" returned: 0 in 0.744s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87917f98-81c0-443b-93c1-d16fe13e59a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:45:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7d832a-3dfc-46f8-80c1-254753d68d17]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:13 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 Nov 02 10:45:13 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:13 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19" returned: 0 in 0.597s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87917f98-81c0-443b-93c1-d16fe13e59a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:45:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.93e61d1d-a505-49b9-a8b1-96a1fd7bce10 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:14 devstack sudo[94647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.93e61d1d-a505-49b9-a8b1-96a1fd7bce10 Nov 02 10:45:14 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:14 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.93e61d1d-a505-49b9-a8b1-96a1fd7bce10" returned: 0 in 0.816s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.93e61d1d-a505-49b9-a8b1-96a1fd7bce10 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:14 devstack sudo[94652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.93e61d1d-a505-49b9-a8b1-96a1fd7bce10 Nov 02 10:45:14 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:15 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.93e61d1d-a505-49b9-a8b1-96a1fd7bce10" returned: 0 in 0.506s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-quobyte-93e61d1d-a505-49b9-a8b1-96a1fd7bce10" released by "_delete_snapshot" :: held 2.872s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-quobyte-87917f98-81c0-443b-93c1-d16fe13e59a1" released by "delete_snapshot" :: held 2.910s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:15 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] Created reservations ['6f59fbef-c13f-4738-bb49-97e61970b875', 'a54e24e6-dd51-4c97-9007-48f27cf986bb', '52771a30-855f-4779-b821-6524447ed3f1', '4e9714e5-8696-4bdd-81f5-a03c06f596b2'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:15 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] Delete snapshot completed successfully. Nov 02 10:45:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-074d59e5-3af7-4f71-a771-e4f6a7e31968 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-93e61d1d-a505-49b9-a8b1-96a1fd7bce10-delete_snapshot" released by "delete_snapshot" :: held 3.158s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:16 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=117,cinder:UPDATE=103,cinder:INSERT=18,cinder:DELETE=2 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:45:16 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=121,cinder:UPDATE=105,cinder:INSERT=36,cinder:DELETE=7 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:45:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-081d5ad4-96fc-4e0c-9a41-098eafccb44d tempest-SnapshotsActionsTest-2110103102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-081d5ad4-96fc-4e0c-9a41-098eafccb44d tempest-SnapshotsActionsTest-2110103102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-081d5ad4-96fc-4e0c-9a41-098eafccb44d tempest-SnapshotsActionsTest-2110103102 None] Creating offline snapshot 359321b2-0ba1-4984-968b-bbe91ec79112 of volume 87917f98-81c0-443b-93c1-d16fe13e59a1 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:45:16 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d672ed0-93c8-43d6-95b3-5ac24c9524f3]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-081d5ad4-96fc-4e0c-9a41-098eafccb44d tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:16 devstack sudo[94655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 Nov 02 10:45:16 devstack sudo[94655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:16 devstack sudo[94655]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-081d5ad4-96fc-4e0c-9a41-098eafccb44d tempest-SnapshotsActionsTest-2110103102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19" returned: 0 in 0.500s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-081d5ad4-96fc-4e0c-9a41-098eafccb44d tempest-SnapshotsActionsTest-2110103102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87917f98-81c0-443b-93c1-d16fe13e59a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:45:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-081d5ad4-96fc-4e0c-9a41-098eafccb44d tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.359321b2-0ba1-4984-968b-bbe91ec79112 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:16 devstack sudo[94661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.359321b2-0ba1-4984-968b-bbe91ec79112 1G Nov 02 10:45:16 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:17 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-081d5ad4-96fc-4e0c-9a41-098eafccb44d tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.359321b2-0ba1-4984-968b-bbe91ec79112 1G" returned: 0 in 0.578s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-081d5ad4-96fc-4e0c-9a41-098eafccb44d tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.359321b2-0ba1-4984-968b-bbe91ec79112 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:17 devstack sudo[94668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.359321b2-0ba1-4984-968b-bbe91ec79112 Nov 02 10:45:17 devstack sudo[94668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:17 devstack sudo[94668]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-081d5ad4-96fc-4e0c-9a41-098eafccb44d tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.359321b2-0ba1-4984-968b-bbe91ec79112" returned: 0 in 0.336s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:17 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-081d5ad4-96fc-4e0c-9a41-098eafccb44d tempest-SnapshotsActionsTest-2110103102 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.359321b2-0ba1-4984-968b-bbe91ec79112 is being set with open permissions: ugo+rw Nov 02 10:45:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-081d5ad4-96fc-4e0c-9a41-098eafccb44d tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.359321b2-0ba1-4984-968b-bbe91ec79112 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:17 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.359321b2-0ba1-4984-968b-bbe91ec79112 Nov 02 10:45:17 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:18 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-081d5ad4-96fc-4e0c-9a41-098eafccb44d tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.359321b2-0ba1-4984-968b-bbe91ec79112" returned: 0 in 0.264s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-081d5ad4-96fc-4e0c-9a41-098eafccb44d tempest-SnapshotsActionsTest-2110103102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:18 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-081d5ad4-96fc-4e0c-9a41-098eafccb44d tempest-SnapshotsActionsTest-2110103102 None] Create snapshot completed successfully Nov 02 10:45:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] Acquiring lock "cinder-359321b2-0ba1-4984-968b-bbe91ec79112-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-359321b2-0ba1-4984-968b-bbe91ec79112-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] Acquiring lock "cinder-quobyte-87917f98-81c0-443b-93c1-d16fe13e59a1" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-quobyte-87917f98-81c0-443b-93c1-d16fe13e59a1" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] Acquiring lock "cinder-quobyte-359321b2-0ba1-4984-968b-bbe91ec79112" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-quobyte-359321b2-0ba1-4984-968b-bbe91ec79112" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] Deleting offline snapshot 359321b2-0ba1-4984-968b-bbe91ec79112 of volume 87917f98-81c0-443b-93c1-d16fe13e59a1 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:45:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] snapshot_file for this snap is: volume-87917f98-81c0-443b-93c1-d16fe13e59a1.359321b2-0ba1-4984-968b-bbe91ec79112 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:45:18 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[648d08d3-cbae-4df0-ac6f-9ae23cf0231c]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.359321b2-0ba1-4984-968b-bbe91ec79112 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:18 devstack sudo[94706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.359321b2-0ba1-4984-968b-bbe91ec79112 Nov 02 10:45:18 devstack sudo[94706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:19 devstack sudo[94706]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.359321b2-0ba1-4984-968b-bbe91ec79112" returned: 0 in 0.509s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87917f98-81c0-443b-93c1-d16fe13e59a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:45:19 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7626a71c-5366-4c86-a3b4-1119dcc869b2]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:19 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 Nov 02 10:45:19 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:19 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19" returned: 0 in 0.541s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87917f98-81c0-443b-93c1-d16fe13e59a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:45:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.359321b2-0ba1-4984-968b-bbe91ec79112 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:19 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.359321b2-0ba1-4984-968b-bbe91ec79112 Nov 02 10:45:19 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:20 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.359321b2-0ba1-4984-968b-bbe91ec79112" returned: 0 in 0.406s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.359321b2-0ba1-4984-968b-bbe91ec79112 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:20 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.359321b2-0ba1-4984-968b-bbe91ec79112 Nov 02 10:45:20 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:20 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.359321b2-0ba1-4984-968b-bbe91ec79112" returned: 0 in 0.325s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-quobyte-359321b2-0ba1-4984-968b-bbe91ec79112" released by "_delete_snapshot" :: held 1.923s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-quobyte-87917f98-81c0-443b-93c1-d16fe13e59a1" released by "delete_snapshot" :: held 1.961s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:20 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] Created reservations ['036efc83-c9ea-4b42-ab0e-f22b2748b9a7', '246ad69b-cbda-4e40-96f1-0324ff484cf0', 'fbc7e5dd-d6cb-4907-8ac4-5c31228e974d', '901c0875-7225-415a-bf14-d09352424286'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:20 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] Delete snapshot completed successfully. Nov 02 10:45:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c0eb3eae-73c2-4caa-b852-9cca22a49fc9 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-359321b2-0ba1-4984-968b-bbe91ec79112-delete_snapshot" released by "delete_snapshot" :: held 2.293s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-48749047-a8c6-4981-93ce-2dadcfdf1077 tempest-SnapshotsActionsTest-2110103102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-48749047-a8c6-4981-93ce-2dadcfdf1077 tempest-SnapshotsActionsTest-2110103102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-48749047-a8c6-4981-93ce-2dadcfdf1077 tempest-SnapshotsActionsTest-2110103102 None] Creating offline snapshot 2ecd4417-c2f4-496a-93a5-e7b5c1e8e806 of volume 87917f98-81c0-443b-93c1-d16fe13e59a1 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:45:22 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b5c5d1-6a31-45d9-bd63-5ce5e10d58f7]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-48749047-a8c6-4981-93ce-2dadcfdf1077 tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:22 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 Nov 02 10:45:22 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:22 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-48749047-a8c6-4981-93ce-2dadcfdf1077 tempest-SnapshotsActionsTest-2110103102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19" returned: 0 in 0.431s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-48749047-a8c6-4981-93ce-2dadcfdf1077 tempest-SnapshotsActionsTest-2110103102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87917f98-81c0-443b-93c1-d16fe13e59a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:45:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-48749047-a8c6-4981-93ce-2dadcfdf1077 tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.2ecd4417-c2f4-496a-93a5-e7b5c1e8e806 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:22 devstack sudo[94738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.2ecd4417-c2f4-496a-93a5-e7b5c1e8e806 1G Nov 02 10:45:22 devstack sudo[94738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:23 devstack sudo[94738]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-48749047-a8c6-4981-93ce-2dadcfdf1077 tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.2ecd4417-c2f4-496a-93a5-e7b5c1e8e806 1G" returned: 0 in 0.538s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-48749047-a8c6-4981-93ce-2dadcfdf1077 tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.2ecd4417-c2f4-496a-93a5-e7b5c1e8e806 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:23 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.2ecd4417-c2f4-496a-93a5-e7b5c1e8e806 Nov 02 10:45:23 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:23 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-48749047-a8c6-4981-93ce-2dadcfdf1077 tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.2ecd4417-c2f4-496a-93a5-e7b5c1e8e806" returned: 0 in 0.369s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:23 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-48749047-a8c6-4981-93ce-2dadcfdf1077 tempest-SnapshotsActionsTest-2110103102 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.2ecd4417-c2f4-496a-93a5-e7b5c1e8e806 is being set with open permissions: ugo+rw Nov 02 10:45:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-48749047-a8c6-4981-93ce-2dadcfdf1077 tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.2ecd4417-c2f4-496a-93a5-e7b5c1e8e806 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:23 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.2ecd4417-c2f4-496a-93a5-e7b5c1e8e806 Nov 02 10:45:23 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:23 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-48749047-a8c6-4981-93ce-2dadcfdf1077 tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.2ecd4417-c2f4-496a-93a5-e7b5c1e8e806" returned: 0 in 0.275s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-48749047-a8c6-4981-93ce-2dadcfdf1077 tempest-SnapshotsActionsTest-2110103102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.740s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-48749047-a8c6-4981-93ce-2dadcfdf1077 tempest-SnapshotsActionsTest-2110103102 None] Create snapshot completed successfully Nov 02 10:45:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] Acquiring lock "cinder-2ecd4417-c2f4-496a-93a5-e7b5c1e8e806-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-2ecd4417-c2f4-496a-93a5-e7b5c1e8e806-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] Acquiring lock "cinder-quobyte-87917f98-81c0-443b-93c1-d16fe13e59a1" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-quobyte-87917f98-81c0-443b-93c1-d16fe13e59a1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] Acquiring lock "cinder-quobyte-2ecd4417-c2f4-496a-93a5-e7b5c1e8e806" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-quobyte-2ecd4417-c2f4-496a-93a5-e7b5c1e8e806" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] Deleting offline snapshot 2ecd4417-c2f4-496a-93a5-e7b5c1e8e806 of volume 87917f98-81c0-443b-93c1-d16fe13e59a1 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:45:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] snapshot_file for this snap is: volume-87917f98-81c0-443b-93c1-d16fe13e59a1.2ecd4417-c2f4-496a-93a5-e7b5c1e8e806 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:45:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adcd192-9f23-4435-bbae-54cdf65258f2]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.2ecd4417-c2f4-496a-93a5-e7b5c1e8e806 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:24 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.2ecd4417-c2f4-496a-93a5-e7b5c1e8e806 Nov 02 10:45:24 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:24 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.2ecd4417-c2f4-496a-93a5-e7b5c1e8e806" returned: 0 in 0.364s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87917f98-81c0-443b-93c1-d16fe13e59a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:45:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22d5099-ea8a-4563-85c2-b215581a3b8c]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:24 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 Nov 02 10:45:24 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:25 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19" returned: 0 in 0.367s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87917f98-81c0-443b-93c1-d16fe13e59a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:45:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.2ecd4417-c2f4-496a-93a5-e7b5c1e8e806 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:25 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.2ecd4417-c2f4-496a-93a5-e7b5c1e8e806 Nov 02 10:45:25 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:25 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.2ecd4417-c2f4-496a-93a5-e7b5c1e8e806" returned: 0 in 0.401s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.2ecd4417-c2f4-496a-93a5-e7b5c1e8e806 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:25 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.2ecd4417-c2f4-496a-93a5-e7b5c1e8e806 Nov 02 10:45:25 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:25 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.2ecd4417-c2f4-496a-93a5-e7b5c1e8e806" returned: 0 in 0.254s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-quobyte-2ecd4417-c2f4-496a-93a5-e7b5c1e8e806" released by "_delete_snapshot" :: held 1.495s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-quobyte-87917f98-81c0-443b-93c1-d16fe13e59a1" released by "delete_snapshot" :: held 1.519s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:25 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] Created reservations ['2759425d-e722-4104-ac0e-e15e28218492', 'c42964ad-1ede-48c7-9c8c-7543105d9b82', 'a9c26322-39d6-4e02-964e-eee79c207e4b', '44d502ab-f410-4d14-a411-b81088f2935f'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:26 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] Delete snapshot completed successfully. Nov 02 10:45:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7b7a2b9a-a2bd-49eb-a105-b8029d116dc8 tempest-SnapshotsActionsTest-685142492 None] Lock "cinder-2ecd4417-c2f4-496a-93a5-e7b5c1e8e806-delete_snapshot" released by "delete_snapshot" :: held 1.660s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] Acquiring lock "cinder-cea179c3-d4e2-4b91-9d35-0ce69187cf19-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] Lock "cinder-cea179c3-d4e2-4b91-9d35-0ce69187cf19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] Acquiring lock "cinder-quobyte-87917f98-81c0-443b-93c1-d16fe13e59a1" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] Lock "cinder-quobyte-87917f98-81c0-443b-93c1-d16fe13e59a1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] Acquiring lock "cinder-quobyte-cea179c3-d4e2-4b91-9d35-0ce69187cf19" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] Lock "cinder-quobyte-cea179c3-d4e2-4b91-9d35-0ce69187cf19" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] Deleting offline snapshot cea179c3-d4e2-4b91-9d35-0ce69187cf19 of volume 87917f98-81c0-443b-93c1-d16fe13e59a1 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:45:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] snapshot_file for this snap is: volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:45:27 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2bae06-2efa-4cd8-ab56-57ad86665e06]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:27 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 Nov 02 10:45:27 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:27 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19" returned: 0 in 0.426s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87917f98-81c0-443b-93c1-d16fe13e59a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:45:27 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fa2bc3-5060-4e00-8735-9fccb5c317da]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:27 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1 Nov 02 10:45:27 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:45:28 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Flow 'volume_create_manager' (50bb4a97-2055-4237-8835-f95bba12921d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d1ed8a-b6d0-4f47-954c-e1d8edc111e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1" returned: 0 in 0.460s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:28 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 Nov 02 10:45:28 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d1ed8a-b6d0-4f47-954c-e1d8edc111e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-550104917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6edf1ed2-9ccd-401e-a4bc-7f6f717b1636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e61bb5b006d47aeac202c9572479c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:28Z,use_quota=True,user_id='de53b89c8dd6482098a3d51ec6281830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a472ea1-9e93-4d01-8a6f-8fd72c947f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a472ea1-9e93-4d01-8a6f-8fd72c947f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37eb6d5e-9832-4c60-93d5-4ed548a7586a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37eb6d5e-9832-4c60-93d5-4ed548a7586a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6edf1ed2-9ccd-401e-a4bc-7f6f717b1636', 'volume_name': 'volume-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e9e229f-267e-419f-a458-1d9050f1bd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e9e229f-267e-419f-a458-1d9050f1bd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b98991-ae43-4458-a50f-e15ad97f42d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:28 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Volume 6edf1ed2-9ccd-401e-a4bc-7f6f717b1636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636', 'volume_size': 1} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-550104917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6edf1ed2-9ccd-401e-a4bc-7f6f717b1636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e61bb5b006d47aeac202c9572479c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:28Z,use_quota=True,user_id='de53b89c8dd6482098a3d51ec6281830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Creating volume 6edf1ed2-9ccd-401e-a4bc-7f6f717b1636 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:45:28 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:28 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636 1073741824 Nov 02 10:45:28 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:28 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19" returned: 0 in 0.384s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:28 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19 Nov 02 10:45:28 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:28 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636 1073741824" returned: 0 in 0.467s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:28 devstack sudo[94855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636 Nov 02 10:45:28 devstack sudo[94855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:28 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1.cea179c3-d4e2-4b91-9d35-0ce69187cf19" returned: 0 in 0.277s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] Lock "cinder-quobyte-cea179c3-d4e2-4b91-9d35-0ce69187cf19" released by "_delete_snapshot" :: held 1.693s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] Lock "cinder-quobyte-87917f98-81c0-443b-93c1-d16fe13e59a1" released by "delete_snapshot" :: held 1.718s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:28 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] Created reservations ['d4a46f7b-62ac-4296-96d2-5855b5c1e261', 'cc932a40-2517-4586-b186-db79ce1ac484', 'f843faa1-9750-4f96-9547-3209e7152023', 'a97924a6-f944-4624-91aa-8efb8746abbc'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:28 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] Delete snapshot completed successfully. Nov 02 10:45:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c4972ed-3867-4dfa-80ef-9a43961ae2bf tempest-SnapshotsActionsTest-2110103102 None] Lock "cinder-cea179c3-d4e2-4b91-9d35-0ce69187cf19-delete_snapshot" released by "delete_snapshot" :: held 1.869s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:29 devstack sudo[94855]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636" returned: 0 in 0.266s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:45:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b98991-ae43-4458-a50f-e15ad97f42d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d481964c-00a6-4006-b5e8-e1ed877473b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:29 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Volume volume-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636 (6edf1ed2-9ccd-401e-a4bc-7f6f717b1636): created successfully Nov 02 10:45:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d481964c-00a6-4006-b5e8-e1ed877473b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Flow 'volume_create_manager' (50bb4a97-2055-4237-8835-f95bba12921d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-853371e2-9422-439d-8b90-38fa678135bd tempest-VolumeQuotasAdminTestJSON-461527947 None] Created volume successfully. Nov 02 10:45:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9bb9abb0-fb6f-4f3a-8e18-3377b31360b3 tempest-SnapshotsActionsTest-2110103102 None] Acquiring lock "cinder-87917f98-81c0-443b-93c1-d16fe13e59a1-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9bb9abb0-fb6f-4f3a-8e18-3377b31360b3 tempest-SnapshotsActionsTest-2110103102 None] Lock "cinder-87917f98-81c0-443b-93c1-d16fe13e59a1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9bb9abb0-fb6f-4f3a-8e18-3377b31360b3 tempest-SnapshotsActionsTest-2110103102 None] Acquiring lock "cinder-quobyte-87917f98-81c0-443b-93c1-d16fe13e59a1" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9bb9abb0-fb6f-4f3a-8e18-3377b31360b3 tempest-SnapshotsActionsTest-2110103102 None] Lock "cinder-quobyte-87917f98-81c0-443b-93c1-d16fe13e59a1" acquired by "delete_volume" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:29 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fae5115-5216-46b7-a8c2-2088f234a63d]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9bb9abb0-fb6f-4f3a-8e18-3377b31360b3 tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:29 devstack sudo[94865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1 Nov 02 10:45:29 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:29 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9bb9abb0-fb6f-4f3a-8e18-3377b31360b3 tempest-SnapshotsActionsTest-2110103102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1" returned: 0 in 0.383s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9bb9abb0-fb6f-4f3a-8e18-3377b31360b3 tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:29 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1 Nov 02 10:45:29 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:30 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9bb9abb0-fb6f-4f3a-8e18-3377b31360b3 tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87917f98-81c0-443b-93c1-d16fe13e59a1" returned: 0 in 0.276s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9bb9abb0-fb6f-4f3a-8e18-3377b31360b3 tempest-SnapshotsActionsTest-2110103102 None] Lock "cinder-quobyte-87917f98-81c0-443b-93c1-d16fe13e59a1" released by "delete_volume" :: held 0.739s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:30 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-9bb9abb0-fb6f-4f3a-8e18-3377b31360b3 tempest-SnapshotsActionsTest-2110103102 None] Created reservations ['4eb1a0ab-7bb8-436c-a9df-ec3b773b08b7', '6832ec6d-3f79-4620-8521-c88f8d742290', '663ebaee-d791-45c6-aff1-6e380f987611', 'bc3b61d1-107e-4643-a40e-ae5431f75d0b'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-45a36606-ae7b-44d3-ac41-400f9c519445 tempest-VolumeQuotasAdminTestJSON-461527947 None] Acquiring lock "cinder-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9bb9abb0-fb6f-4f3a-8e18-3377b31360b3 tempest-SnapshotsActionsTest-2110103102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9bb9abb0-fb6f-4f3a-8e18-3377b31360b3 tempest-SnapshotsActionsTest-2110103102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9bb9abb0-fb6f-4f3a-8e18-3377b31360b3 tempest-SnapshotsActionsTest-2110103102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9bb9abb0-fb6f-4f3a-8e18-3377b31360b3 tempest-SnapshotsActionsTest-2110103102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9bb9abb0-fb6f-4f3a-8e18-3377b31360b3 tempest-SnapshotsActionsTest-2110103102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9bb9abb0-fb6f-4f3a-8e18-3377b31360b3 tempest-SnapshotsActionsTest-2110103102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-45a36606-ae7b-44d3-ac41-400f9c519445 tempest-VolumeQuotasAdminTestJSON-461527947 None] Lock "cinder-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:30 devstack sudo[94873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:45:30 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-45a36606-ae7b-44d3-ac41-400f9c519445 tempest-VolumeQuotasAdminTestJSON-461527947 None] Acquiring lock "cinder-quobyte-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-45a36606-ae7b-44d3-ac41-400f9c519445 tempest-VolumeQuotasAdminTestJSON-461527947 None] Lock "cinder-quobyte-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:30 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de764a8-d257-4974-a761-12727183028f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-45a36606-ae7b-44d3-ac41-400f9c519445 tempest-VolumeQuotasAdminTestJSON-461527947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:30 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636 Nov 02 10:45:30 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:30 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9bb9abb0-fb6f-4f3a-8e18-3377b31360b3 tempest-SnapshotsActionsTest-2110103102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.328s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:30 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-9bb9abb0-fb6f-4f3a-8e18-3377b31360b3 tempest-SnapshotsActionsTest-2110103102 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:30 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9bb9abb0-fb6f-4f3a-8e18-3377b31360b3 tempest-SnapshotsActionsTest-2110103102 None] Deleted volume successfully. Nov 02 10:45:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9bb9abb0-fb6f-4f3a-8e18-3377b31360b3 tempest-SnapshotsActionsTest-2110103102 None] Lock "cinder-87917f98-81c0-443b-93c1-d16fe13e59a1-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:30 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-45a36606-ae7b-44d3-ac41-400f9c519445 tempest-VolumeQuotasAdminTestJSON-461527947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636" returned: 0 in 0.413s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-45a36606-ae7b-44d3-ac41-400f9c519445 tempest-VolumeQuotasAdminTestJSON-461527947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:30 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636 Nov 02 10:45:30 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:31 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-45a36606-ae7b-44d3-ac41-400f9c519445 tempest-VolumeQuotasAdminTestJSON-461527947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636" returned: 0 in 0.354s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-45a36606-ae7b-44d3-ac41-400f9c519445 tempest-VolumeQuotasAdminTestJSON-461527947 None] Lock "cinder-quobyte-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636" released by "delete_volume" :: held 0.840s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:31 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-45a36606-ae7b-44d3-ac41-400f9c519445 tempest-VolumeQuotasAdminTestJSON-461527947 None] Created reservations ['478ccaab-2cea-47c6-9cd6-fa552501fcc4', '6b7873bd-5ef0-4e50-abb0-4613529875eb', '1b4834ba-1775-47cf-9512-5181e813c64d', 'bebcd531-3beb-426b-a54d-f8ae7fe589f4'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-45a36606-ae7b-44d3-ac41-400f9c519445 tempest-VolumeQuotasAdminTestJSON-461527947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-45a36606-ae7b-44d3-ac41-400f9c519445 tempest-VolumeQuotasAdminTestJSON-461527947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-45a36606-ae7b-44d3-ac41-400f9c519445 tempest-VolumeQuotasAdminTestJSON-461527947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-45a36606-ae7b-44d3-ac41-400f9c519445 tempest-VolumeQuotasAdminTestJSON-461527947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-45a36606-ae7b-44d3-ac41-400f9c519445 tempest-VolumeQuotasAdminTestJSON-461527947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-45a36606-ae7b-44d3-ac41-400f9c519445 tempest-VolumeQuotasAdminTestJSON-461527947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:31 devstack sudo[94886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:45:31 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:31 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-45a36606-ae7b-44d3-ac41-400f9c519445 tempest-VolumeQuotasAdminTestJSON-461527947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.373s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:31 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-45a36606-ae7b-44d3-ac41-400f9c519445 tempest-VolumeQuotasAdminTestJSON-461527947 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-45a36606-ae7b-44d3-ac41-400f9c519445 tempest-VolumeQuotasAdminTestJSON-461527947 None] Deleted volume successfully. Nov 02 10:45:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-45a36606-ae7b-44d3-ac41-400f9c519445 tempest-VolumeQuotasAdminTestJSON-461527947 None] Lock "cinder-6edf1ed2-9ccd-401e-a4bc-7f6f717b1636-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Flow 'volume_create_manager' (9d696e80-3203-436f-b872-2f8285dcf6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b9264f-000d-4af9-a0e3-6535e1832635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b9264f-000d-4af9-a0e3-6535e1832635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1521609989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adade290-2333-42af-8ba3-e89afa9a399c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e61bb5b006d47aeac202c9572479c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:32Z,use_quota=True,user_id='de53b89c8dd6482098a3d51ec6281830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09eb52b7-8935-4d82-86ba-e9726e46030b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09eb52b7-8935-4d82-86ba-e9726e46030b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d0198e-b7f1-4037-93b2-1dddd7ae076d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d0198e-b7f1-4037-93b2-1dddd7ae076d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adade290-2333-42af-8ba3-e89afa9a399c', 'volume_name': 'volume-adade290-2333-42af-8ba3-e89afa9a399c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3abc822-4a9f-4d8a-bcac-6c64c403322e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3abc822-4a9f-4d8a-bcac-6c64c403322e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cccb180b-186b-4b2f-baa0-7aa0167d3363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:32 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Volume adade290-2333-42af-8ba3-e89afa9a399c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adade290-2333-42af-8ba3-e89afa9a399c', 'volume_size': 1} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1521609989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adade290-2333-42af-8ba3-e89afa9a399c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e61bb5b006d47aeac202c9572479c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:32Z,use_quota=True,user_id='de53b89c8dd6482098a3d51ec6281830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Creating volume adade290-2333-42af-8ba3-e89afa9a399c {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:45:32 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:45:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adade290-2333-42af-8ba3-e89afa9a399c 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:32 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adade290-2333-42af-8ba3-e89afa9a399c 1073741824 Nov 02 10:45:32 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:33 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adade290-2333-42af-8ba3-e89afa9a399c 1073741824" returned: 0 in 0.592s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adade290-2333-42af-8ba3-e89afa9a399c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:33 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adade290-2333-42af-8ba3-e89afa9a399c Nov 02 10:45:33 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:33 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adade290-2333-42af-8ba3-e89afa9a399c" returned: 0 in 0.389s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:45:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cccb180b-186b-4b2f-baa0-7aa0167d3363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adade290-2333-42af-8ba3-e89afa9a399c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdeed84-b7e0-4526-8546-0c8ee97fb157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:33 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Volume volume-adade290-2333-42af-8ba3-e89afa9a399c (adade290-2333-42af-8ba3-e89afa9a399c): created successfully Nov 02 10:45:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdeed84-b7e0-4526-8546-0c8ee97fb157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Flow 'volume_create_manager' (9d696e80-3203-436f-b872-2f8285dcf6f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-779ae635-b96a-4030-b568-e6699863ccf4 tempest-VolumeQuotasAdminTestJSON-461527947 None] Created volume successfully. Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Flow 'volume_create_manager' (92fc7972-c37b-4c38-9b4d-c6c10582902a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04baa18b-3ee3-4731-872c-2d2be226c987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04baa18b-3ee3-4731-872c-2d2be226c987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-797846137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60f852c-40f7-439d-b4e6-cfde4494366b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8e8a8804674eeca9bc771fea721ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:34Z,use_quota=True,user_id='12579413456444e793b56d9534eecf8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c281d3fa-64c0-4d35-b1f9-231736ee3a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c281d3fa-64c0-4d35-b1f9-231736ee3a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b30f541-46da-4329-ac90-0679f1ca7038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b30f541-46da-4329-ac90-0679f1ca7038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a60f852c-40f7-439d-b4e6-cfde4494366b', 'volume_name': 'volume-a60f852c-40f7-439d-b4e6-cfde4494366b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d175d917-adfe-40be-be5e-283c7777907f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d175d917-adfe-40be-be5e-283c7777907f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a1984c-764c-42e1-af24-e7b74e7a0807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:34 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Volume a60f852c-40f7-439d-b4e6-cfde4494366b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a60f852c-40f7-439d-b4e6-cfde4494366b', 'volume_size': 1} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-797846137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60f852c-40f7-439d-b4e6-cfde4494366b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8e8a8804674eeca9bc771fea721ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:34Z,use_quota=True,user_id='12579413456444e793b56d9534eecf8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Creating volume a60f852c-40f7-439d-b4e6-cfde4494366b {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:45:34 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a60f852c-40f7-439d-b4e6-cfde4494366b 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:34 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a60f852c-40f7-439d-b4e6-cfde4494366b 1073741824 Nov 02 10:45:34 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-53cb39ae-093b-489b-9013-d79b65787652 req-7b5dd2d6-e5d9-44de-963f-c61a14089c43 tempest-ServerActionsTestOtherA-509339523 None] Terminate volume connection completed successfully. Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-53cb39ae-093b-489b-9013-d79b65787652 req-7b5dd2d6-e5d9-44de-963f-c61a14089c43 tempest-ServerActionsTestOtherA-509339523 None] Deleting attachment 9274053c-e82f-47ce-b310-43834e1fd5b2. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-53cb39ae-093b-489b-9013-d79b65787652 req-145bbb25-1ce8-4191-ba0d-9ea0f80e803e tempest-ServerActionsTestOtherA-509339523 None] Acquiring lock "cinder-492a74fa-495d-4de2-82df-a30e6ebba35a-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-53cb39ae-093b-489b-9013-d79b65787652 req-145bbb25-1ce8-4191-ba0d-9ea0f80e803e tempest-ServerActionsTestOtherA-509339523 None] Lock "cinder-492a74fa-495d-4de2-82df-a30e6ebba35a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-53cb39ae-093b-489b-9013-d79b65787652 req-145bbb25-1ce8-4191-ba0d-9ea0f80e803e tempest-ServerActionsTestOtherA-509339523 None] Acquiring lock "cinder-quobyte-492a74fa-495d-4de2-82df-a30e6ebba35a" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-53cb39ae-093b-489b-9013-d79b65787652 req-145bbb25-1ce8-4191-ba0d-9ea0f80e803e tempest-ServerActionsTestOtherA-509339523 None] Lock "cinder-quobyte-492a74fa-495d-4de2-82df-a30e6ebba35a" acquired by "delete_volume" :: waited 0.036s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d16f2a-2d89-4f4b-bbd9-03c4ed1bbf5f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-53cb39ae-093b-489b-9013-d79b65787652 req-145bbb25-1ce8-4191-ba0d-9ea0f80e803e tempest-ServerActionsTestOtherA-509339523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-492a74fa-495d-4de2-82df-a30e6ebba35a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:34 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a60f852c-40f7-439d-b4e6-cfde4494366b 1073741824" returned: 0 in 0.663s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:34 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-492a74fa-495d-4de2-82df-a30e6ebba35a Nov 02 10:45:34 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a60f852c-40f7-439d-b4e6-cfde4494366b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:34 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a60f852c-40f7-439d-b4e6-cfde4494366b Nov 02 10:45:34 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:35 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-53cb39ae-093b-489b-9013-d79b65787652 req-145bbb25-1ce8-4191-ba0d-9ea0f80e803e tempest-ServerActionsTestOtherA-509339523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-492a74fa-495d-4de2-82df-a30e6ebba35a" returned: 0 in 0.527s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-53cb39ae-093b-489b-9013-d79b65787652 req-145bbb25-1ce8-4191-ba0d-9ea0f80e803e tempest-ServerActionsTestOtherA-509339523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-492a74fa-495d-4de2-82df-a30e6ebba35a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:35 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-492a74fa-495d-4de2-82df-a30e6ebba35a Nov 02 10:45:35 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:35 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a60f852c-40f7-439d-b4e6-cfde4494366b" returned: 0 in 0.443s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a1984c-764c-42e1-af24-e7b74e7a0807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a60f852c-40f7-439d-b4e6-cfde4494366b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f9845b-39f9-4baa-8311-5d618ef702fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:35 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Volume volume-a60f852c-40f7-439d-b4e6-cfde4494366b (a60f852c-40f7-439d-b4e6-cfde4494366b): created successfully Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f9845b-39f9-4baa-8311-5d618ef702fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Flow 'volume_create_manager' (92fc7972-c37b-4c38-9b4d-c6c10582902a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9d78e5f4-dc7a-4470-b583-d131795ad8fa tempest-ServerActionsTestOtherA-509339523 None] Acquiring lock "cinder-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:35 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-88e7c98f-3936-464f-8b76-62505439c9d4 tempest-AttachVolumeNegativeTest-1125873498 None] Created volume successfully. Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9d78e5f4-dc7a-4470-b583-d131795ad8fa tempest-ServerActionsTestOtherA-509339523 None] Lock "cinder-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9d78e5f4-dc7a-4470-b583-d131795ad8fa tempest-ServerActionsTestOtherA-509339523 None] Acquiring lock "cinder-quobyte-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:35 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ef0dd97c-ba75-48fe-9dd5-fdcb8763c796 tempest-VolumeQuotasAdminTestJSON-2080563476 None] Transfer volume completed successfully. Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9d78e5f4-dc7a-4470-b583-d131795ad8fa tempest-ServerActionsTestOtherA-509339523 None] Lock "cinder-quobyte-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[889df14b-2969-4ac6-adb1-bc22cf5a2807]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d78e5f4-dc7a-4470-b583-d131795ad8fa tempest-ServerActionsTestOtherA-509339523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:35 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-53cb39ae-093b-489b-9013-d79b65787652 req-145bbb25-1ce8-4191-ba0d-9ea0f80e803e tempest-ServerActionsTestOtherA-509339523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-492a74fa-495d-4de2-82df-a30e6ebba35a" returned: 0 in 0.427s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-53cb39ae-093b-489b-9013-d79b65787652 req-145bbb25-1ce8-4191-ba0d-9ea0f80e803e tempest-ServerActionsTestOtherA-509339523 None] Lock "cinder-quobyte-492a74fa-495d-4de2-82df-a30e6ebba35a" released by "delete_volume" :: held 1.041s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:35 devstack sudo[94944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3 Nov 02 10:45:35 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG cinder.quota [req-53cb39ae-093b-489b-9013-d79b65787652 req-145bbb25-1ce8-4191-ba0d-9ea0f80e803e tempest-ServerActionsTestOtherA-509339523 None] Created reservations ['09437363-42b8-493f-ab26-638dc300f57a', '0ec918f8-d73b-4648-bca4-e12ab2cfa9d9', 'ef8b7862-46bc-40b5-b196-53458ee1342f', 'a37777a4-a02e-49de-9f10-126ce2f7527e'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-53cb39ae-093b-489b-9013-d79b65787652 req-145bbb25-1ce8-4191-ba0d-9ea0f80e803e tempest-ServerActionsTestOtherA-509339523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-53cb39ae-093b-489b-9013-d79b65787652 req-145bbb25-1ce8-4191-ba0d-9ea0f80e803e tempest-ServerActionsTestOtherA-509339523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-53cb39ae-093b-489b-9013-d79b65787652 req-145bbb25-1ce8-4191-ba0d-9ea0f80e803e tempest-ServerActionsTestOtherA-509339523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-53cb39ae-093b-489b-9013-d79b65787652 req-145bbb25-1ce8-4191-ba0d-9ea0f80e803e tempest-ServerActionsTestOtherA-509339523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-53cb39ae-093b-489b-9013-d79b65787652 req-145bbb25-1ce8-4191-ba0d-9ea0f80e803e tempest-ServerActionsTestOtherA-509339523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-53cb39ae-093b-489b-9013-d79b65787652 req-145bbb25-1ce8-4191-ba0d-9ea0f80e803e tempest-ServerActionsTestOtherA-509339523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:35 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:45:35 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:36 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d78e5f4-dc7a-4470-b583-d131795ad8fa tempest-ServerActionsTestOtherA-509339523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3" returned: 0 in 0.476s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d78e5f4-dc7a-4470-b583-d131795ad8fa tempest-ServerActionsTestOtherA-509339523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:36 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3 Nov 02 10:45:36 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c619bca3-f273-4a2c-86df-2f45b100ed67 tempest-VolumeQuotasAdminTestJSON-934659362 None] Acquiring lock "cinder-adade290-2333-42af-8ba3-e89afa9a399c-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:36 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-53cb39ae-093b-489b-9013-d79b65787652 req-145bbb25-1ce8-4191-ba0d-9ea0f80e803e tempest-ServerActionsTestOtherA-509339523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.402s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:36 devstack cinder-volume[87084]: DEBUG cinder.manager [req-53cb39ae-093b-489b-9013-d79b65787652 req-145bbb25-1ce8-4191-ba0d-9ea0f80e803e tempest-ServerActionsTestOtherA-509339523 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c619bca3-f273-4a2c-86df-2f45b100ed67 tempest-VolumeQuotasAdminTestJSON-934659362 None] Lock "cinder-adade290-2333-42af-8ba3-e89afa9a399c-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:36 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-53cb39ae-093b-489b-9013-d79b65787652 req-145bbb25-1ce8-4191-ba0d-9ea0f80e803e tempest-ServerActionsTestOtherA-509339523 None] Deleted volume successfully. Nov 02 10:45:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-53cb39ae-093b-489b-9013-d79b65787652 req-145bbb25-1ce8-4191-ba0d-9ea0f80e803e tempest-ServerActionsTestOtherA-509339523 None] Lock "cinder-492a74fa-495d-4de2-82df-a30e6ebba35a-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c619bca3-f273-4a2c-86df-2f45b100ed67 tempest-VolumeQuotasAdminTestJSON-934659362 None] Acquiring lock "cinder-quobyte-adade290-2333-42af-8ba3-e89afa9a399c" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c619bca3-f273-4a2c-86df-2f45b100ed67 tempest-VolumeQuotasAdminTestJSON-934659362 None] Lock "cinder-quobyte-adade290-2333-42af-8ba3-e89afa9a399c" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:36 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0075009e-f0da-49ab-bd20-b3358dabd41d]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c619bca3-f273-4a2c-86df-2f45b100ed67 tempest-VolumeQuotasAdminTestJSON-934659362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adade290-2333-42af-8ba3-e89afa9a399c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:36 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d78e5f4-dc7a-4470-b583-d131795ad8fa tempest-ServerActionsTestOtherA-509339523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3" returned: 0 in 0.406s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9d78e5f4-dc7a-4470-b583-d131795ad8fa tempest-ServerActionsTestOtherA-509339523 None] Lock "cinder-quobyte-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3" released by "delete_volume" :: held 0.960s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:36 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adade290-2333-42af-8ba3-e89afa9a399c Nov 02 10:45:36 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:36 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-9d78e5f4-dc7a-4470-b583-d131795ad8fa tempest-ServerActionsTestOtherA-509339523 None] Created reservations ['0d815095-24ec-44af-ab77-d32de3698381', '9bea4f7b-739d-4274-aedd-2b7288bf4087', '64286bd6-f451-4f8c-959b-967b5784d464', '6a5ec687-f4b2-44f4-a6f8-77cd01ec655a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9d78e5f4-dc7a-4470-b583-d131795ad8fa tempest-ServerActionsTestOtherA-509339523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9d78e5f4-dc7a-4470-b583-d131795ad8fa tempest-ServerActionsTestOtherA-509339523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9d78e5f4-dc7a-4470-b583-d131795ad8fa tempest-ServerActionsTestOtherA-509339523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9d78e5f4-dc7a-4470-b583-d131795ad8fa tempest-ServerActionsTestOtherA-509339523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9d78e5f4-dc7a-4470-b583-d131795ad8fa tempest-ServerActionsTestOtherA-509339523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d78e5f4-dc7a-4470-b583-d131795ad8fa tempest-ServerActionsTestOtherA-509339523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:36 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:45:36 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:37 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c619bca3-f273-4a2c-86df-2f45b100ed67 tempest-VolumeQuotasAdminTestJSON-934659362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adade290-2333-42af-8ba3-e89afa9a399c" returned: 0 in 0.563s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c619bca3-f273-4a2c-86df-2f45b100ed67 tempest-VolumeQuotasAdminTestJSON-934659362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adade290-2333-42af-8ba3-e89afa9a399c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:37 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adade290-2333-42af-8ba3-e89afa9a399c Nov 02 10:45:37 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:37 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d78e5f4-dc7a-4470-b583-d131795ad8fa tempest-ServerActionsTestOtherA-509339523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.371s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-9d78e5f4-dc7a-4470-b583-d131795ad8fa tempest-ServerActionsTestOtherA-509339523 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9d78e5f4-dc7a-4470-b583-d131795ad8fa tempest-ServerActionsTestOtherA-509339523 None] Deleted volume successfully. Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9d78e5f4-dc7a-4470-b583-d131795ad8fa tempest-ServerActionsTestOtherA-509339523 None] Lock "cinder-4c1d5aae-8a1f-42f5-b71e-1f41904a70b3-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-6d0cf828-fb50-4a64-94bd-f92fe1084915 req-43ae1e8e-25a9-4d1c-aadc-426e9b5fce91 tempest-AttachVolumeNegativeTest-1125873498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-6d0cf828-fb50-4a64-94bd-f92fe1084915 req-43ae1e8e-25a9-4d1c-aadc-426e9b5fce91 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-6d0cf828-fb50-4a64-94bd-f92fe1084915 req-43ae1e8e-25a9-4d1c-aadc-426e9b5fce91 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-6d0cf828-fb50-4a64-94bd-f92fe1084915 req-43ae1e8e-25a9-4d1c-aadc-426e9b5fce91 tempest-AttachVolumeNegativeTest-1125873498 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-a60f852c-40f7-439d-b4e6-cfde4494366b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e06de3e-ae93-40a6-938d-f600e74a9a1f', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:45:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-6d0cf828-fb50-4a64-94bd-f92fe1084915 req-43ae1e8e-25a9-4d1c-aadc-426e9b5fce91 tempest-AttachVolumeNegativeTest-1125873498 None] attachment_update completed successfully. Nov 02 10:45:37 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c619bca3-f273-4a2c-86df-2f45b100ed67 tempest-VolumeQuotasAdminTestJSON-934659362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adade290-2333-42af-8ba3-e89afa9a399c" returned: 0 in 0.317s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c619bca3-f273-4a2c-86df-2f45b100ed67 tempest-VolumeQuotasAdminTestJSON-934659362 None] Lock "cinder-quobyte-adade290-2333-42af-8ba3-e89afa9a399c" released by "delete_volume" :: held 0.948s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c619bca3-f273-4a2c-86df-2f45b100ed67 tempest-VolumeQuotasAdminTestJSON-934659362 None] Created reservations ['3696ccd9-7599-4c18-a240-7482c3840df6', 'd821286d-a4fb-402d-af81-21a78779f891', '0c0d1be1-e090-42eb-8dc2-4a737293c5f2', '326bb4b7-1db8-48a3-a3b5-f391ff395f07'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c619bca3-f273-4a2c-86df-2f45b100ed67 tempest-VolumeQuotasAdminTestJSON-934659362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c619bca3-f273-4a2c-86df-2f45b100ed67 tempest-VolumeQuotasAdminTestJSON-934659362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c619bca3-f273-4a2c-86df-2f45b100ed67 tempest-VolumeQuotasAdminTestJSON-934659362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c619bca3-f273-4a2c-86df-2f45b100ed67 tempest-VolumeQuotasAdminTestJSON-934659362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c619bca3-f273-4a2c-86df-2f45b100ed67 tempest-VolumeQuotasAdminTestJSON-934659362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c619bca3-f273-4a2c-86df-2f45b100ed67 tempest-VolumeQuotasAdminTestJSON-934659362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:37 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:45:37 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:37 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c619bca3-f273-4a2c-86df-2f45b100ed67 tempest-VolumeQuotasAdminTestJSON-934659362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.344s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c619bca3-f273-4a2c-86df-2f45b100ed67 tempest-VolumeQuotasAdminTestJSON-934659362 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c619bca3-f273-4a2c-86df-2f45b100ed67 tempest-VolumeQuotasAdminTestJSON-934659362 None] Deleted volume successfully. Nov 02 10:45:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c619bca3-f273-4a2c-86df-2f45b100ed67 tempest-VolumeQuotasAdminTestJSON-934659362 None] Lock "cinder-adade290-2333-42af-8ba3-e89afa9a399c-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:40 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-50f2d386-7a6f-428e-9d0f-0e4a88a08691 req-faa63547-902f-4384-9ae1-34e0e20232ff tempest-AttachVolumeNegativeTest-1125873498 None] Terminate volume connection completed successfully. Nov 02 10:45:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-50f2d386-7a6f-428e-9d0f-0e4a88a08691 req-faa63547-902f-4384-9ae1-34e0e20232ff tempest-AttachVolumeNegativeTest-1125873498 None] Deleting attachment 4e06de3e-ae93-40a6-938d-f600e74a9a1f. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:45:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-99031c6a-e88c-46ca-8c22-d25eccddf922 tempest-AttachVolumeNegativeTest-1125873498 None] Acquiring lock "cinder-a60f852c-40f7-439d-b4e6-cfde4494366b-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-99031c6a-e88c-46ca-8c22-d25eccddf922 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "cinder-a60f852c-40f7-439d-b4e6-cfde4494366b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-99031c6a-e88c-46ca-8c22-d25eccddf922 tempest-AttachVolumeNegativeTest-1125873498 None] Acquiring lock "cinder-quobyte-a60f852c-40f7-439d-b4e6-cfde4494366b" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-99031c6a-e88c-46ca-8c22-d25eccddf922 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "cinder-quobyte-a60f852c-40f7-439d-b4e6-cfde4494366b" acquired by "delete_volume" :: waited 0.039s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:46 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d111a261-f32c-4d32-a623-629f38bdc5f2]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-99031c6a-e88c-46ca-8c22-d25eccddf922 tempest-AttachVolumeNegativeTest-1125873498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a60f852c-40f7-439d-b4e6-cfde4494366b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:46 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a60f852c-40f7-439d-b4e6-cfde4494366b Nov 02 10:45:46 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:47 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-99031c6a-e88c-46ca-8c22-d25eccddf922 tempest-AttachVolumeNegativeTest-1125873498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a60f852c-40f7-439d-b4e6-cfde4494366b" returned: 0 in 0.579s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-99031c6a-e88c-46ca-8c22-d25eccddf922 tempest-AttachVolumeNegativeTest-1125873498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a60f852c-40f7-439d-b4e6-cfde4494366b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:47 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a60f852c-40f7-439d-b4e6-cfde4494366b Nov 02 10:45:47 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Flow 'volume_create_manager' (e30b3eac-9917-48b9-ac1e-132b3bc83162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584ac10f-9ec7-4996-8e15-1bbbb96891ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584ac10f-9ec7-4996-8e15-1bbbb96891ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1457090426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107aa9aa-a0ae-4687-b5f3-3fd0a9a77063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c8dc819fe7743198a64ebae52a2b50e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:47Z,use_quota=True,user_id='613b2a4746404c71a3f3b67d0eceab78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd413798-ffdc-47f1-a87c-c669d602be88),volume_type_id=bd413798-ffdc-47f1-a87c-c669d602be88)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8419042e-75b4-45de-b3d6-1054cc44e46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8419042e-75b4-45de-b3d6-1054cc44e46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b859d83-0a88-4e1f-b603-4a4596f54500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b859d83-0a88-4e1f-b603-4a4596f54500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '107aa9aa-a0ae-4687-b5f3-3fd0a9a77063', 'volume_name': 'volume-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe4cae7-8172-45ba-a255-a8f7417219af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe4cae7-8172-45ba-a255-a8f7417219af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1773ec-9594-4835-a421-3e107a214e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:47 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Volume 107aa9aa-a0ae-4687-b5f3-3fd0a9a77063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063', 'volume_size': 1} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1457090426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107aa9aa-a0ae-4687-b5f3-3fd0a9a77063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c8dc819fe7743198a64ebae52a2b50e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:47Z,use_quota=True,user_id='613b2a4746404c71a3f3b67d0eceab78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd413798-ffdc-47f1-a87c-c669d602be88),volume_type_id=bd413798-ffdc-47f1-a87c-c669d602be88)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Creating volume 107aa9aa-a0ae-4687-b5f3-3fd0a9a77063 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:45:47 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:47 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063 1073741824 Nov 02 10:45:47 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:47 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-99031c6a-e88c-46ca-8c22-d25eccddf922 tempest-AttachVolumeNegativeTest-1125873498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a60f852c-40f7-439d-b4e6-cfde4494366b" returned: 0 in 0.310s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-99031c6a-e88c-46ca-8c22-d25eccddf922 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "cinder-quobyte-a60f852c-40f7-439d-b4e6-cfde4494366b" released by "delete_volume" :: held 0.945s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-99031c6a-e88c-46ca-8c22-d25eccddf922 tempest-AttachVolumeNegativeTest-1125873498 None] Created reservations ['52414bfa-0d29-4165-8447-b1def5ff57f4', 'd883c773-46e4-4f80-adb8-ebe10cc9af25', '49f82601-0505-42dc-9bc4-342c94a723d3', 'd95bcb6b-68db-451f-83f4-5abd2fafc5b9'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-99031c6a-e88c-46ca-8c22-d25eccddf922 tempest-AttachVolumeNegativeTest-1125873498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-99031c6a-e88c-46ca-8c22-d25eccddf922 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-99031c6a-e88c-46ca-8c22-d25eccddf922 tempest-AttachVolumeNegativeTest-1125873498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-99031c6a-e88c-46ca-8c22-d25eccddf922 tempest-AttachVolumeNegativeTest-1125873498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-99031c6a-e88c-46ca-8c22-d25eccddf922 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-99031c6a-e88c-46ca-8c22-d25eccddf922 tempest-AttachVolumeNegativeTest-1125873498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:47 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:45:47 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:48 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063 1073741824" returned: 0 in 0.545s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:48 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-99031c6a-e88c-46ca-8c22-d25eccddf922 tempest-AttachVolumeNegativeTest-1125873498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.419s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:48 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-99031c6a-e88c-46ca-8c22-d25eccddf922 tempest-AttachVolumeNegativeTest-1125873498 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:48 devstack sudo[95489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063 Nov 02 10:45:48 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-99031c6a-e88c-46ca-8c22-d25eccddf922 tempest-AttachVolumeNegativeTest-1125873498 None] Deleted volume successfully. Nov 02 10:45:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-99031c6a-e88c-46ca-8c22-d25eccddf922 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "cinder-a60f852c-40f7-439d-b4e6-cfde4494366b-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:48 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063" returned: 0 in 0.393s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:45:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1773ec-9594-4835-a421-3e107a214e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e943c5-78c5-4e13-aa6f-758d0e2f9b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:48 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Volume volume-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063 (107aa9aa-a0ae-4687-b5f3-3fd0a9a77063): created successfully Nov 02 10:45:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e943c5-78c5-4e13-aa6f-758d0e2f9b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Flow 'volume_create_manager' (e30b3eac-9917-48b9-ac1e-132b3bc83162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c472da3c-b593-491b-aa7a-6470a9ccae97 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Created volume successfully. Nov 02 10:45:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ceec17e9-231d-411b-a4c4-8014952434f8 tempest-AttachVolumeNegativeTest-1125873498 None] Acquiring lock "cinder-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ceec17e9-231d-411b-a4c4-8014952434f8 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "cinder-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ceec17e9-231d-411b-a4c4-8014952434f8 tempest-AttachVolumeNegativeTest-1125873498 None] Acquiring lock "cinder-quobyte-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ceec17e9-231d-411b-a4c4-8014952434f8 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "cinder-quobyte-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:49 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae152b6-25a9-4dba-9220-b548b37a7da6]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceec17e9-231d-411b-a4c4-8014952434f8 tempest-AttachVolumeNegativeTest-1125873498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:49 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39 Nov 02 10:45:49 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:49 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceec17e9-231d-411b-a4c4-8014952434f8 tempest-AttachVolumeNegativeTest-1125873498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39" returned: 0 in 0.537s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceec17e9-231d-411b-a4c4-8014952434f8 tempest-AttachVolumeNegativeTest-1125873498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:49 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39 Nov 02 10:45:49 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:50 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceec17e9-231d-411b-a4c4-8014952434f8 tempest-AttachVolumeNegativeTest-1125873498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39" returned: 0 in 0.335s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ceec17e9-231d-411b-a4c4-8014952434f8 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "cinder-quobyte-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39" released by "delete_volume" :: held 0.941s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:50 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-ceec17e9-231d-411b-a4c4-8014952434f8 tempest-AttachVolumeNegativeTest-1125873498 None] Created reservations ['881de0eb-f7ac-4a51-ba0f-29ad742968cc', 'e7b0911c-0d3e-4cfe-8206-60f44390c607', '9e5d9a16-8d1e-410a-8eb9-923eab1ad328', '63fd0f2c-22fb-4a5d-9e47-d7d8da686df7'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5bfdce12-5f9b-4193-8414-8a8b7669c5cc tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5bfdce12-5f9b-4193-8414-8a8b7669c5cc tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5bfdce12-5f9b-4193-8414-8a8b7669c5cc tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5bfdce12-5f9b-4193-8414-8a8b7669c5cc tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5bfdce12-5f9b-4193-8414-8a8b7669c5cc tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5bfdce12-5f9b-4193-8414-8a8b7669c5cc tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:50 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:45:50 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ceec17e9-231d-411b-a4c4-8014952434f8 tempest-AttachVolumeNegativeTest-1125873498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ceec17e9-231d-411b-a4c4-8014952434f8 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ceec17e9-231d-411b-a4c4-8014952434f8 tempest-AttachVolumeNegativeTest-1125873498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ceec17e9-231d-411b-a4c4-8014952434f8 tempest-AttachVolumeNegativeTest-1125873498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ceec17e9-231d-411b-a4c4-8014952434f8 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceec17e9-231d-411b-a4c4-8014952434f8 tempest-AttachVolumeNegativeTest-1125873498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:50 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:45:50 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:50 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5bfdce12-5f9b-4193-8414-8a8b7669c5cc tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.303s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:50 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-5bfdce12-5f9b-4193-8414-8a8b7669c5cc tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:50 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5bfdce12-5f9b-4193-8414-8a8b7669c5cc tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Retype volume completed successfully. Nov 02 10:45:50 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceec17e9-231d-411b-a4c4-8014952434f8 tempest-AttachVolumeNegativeTest-1125873498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.327s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:50 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-ceec17e9-231d-411b-a4c4-8014952434f8 tempest-AttachVolumeNegativeTest-1125873498 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:50 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ceec17e9-231d-411b-a4c4-8014952434f8 tempest-AttachVolumeNegativeTest-1125873498 None] Deleted volume successfully. Nov 02 10:45:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ceec17e9-231d-411b-a4c4-8014952434f8 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "cinder-b9571fb7-1097-4ed2-a55a-cbfd6fe15b39-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2317ac92-6c11-428e-b96c-10a9ebc3d866 tempest-AttachVolumeNegativeTest-1125873498 None] Acquiring lock "cinder-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2317ac92-6c11-428e-b96c-10a9ebc3d866 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "cinder-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2317ac92-6c11-428e-b96c-10a9ebc3d866 tempest-AttachVolumeNegativeTest-1125873498 None] Acquiring lock "cinder-quobyte-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2317ac92-6c11-428e-b96c-10a9ebc3d866 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "cinder-quobyte-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:51 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[705ff518-8c17-4eec-865b-554cad53c41b]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2317ac92-6c11-428e-b96c-10a9ebc3d866 tempest-AttachVolumeNegativeTest-1125873498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Acquiring lock "cinder-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Lock "cinder-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:51 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4 Nov 02 10:45:51 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Acquiring lock "cinder-quobyte-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Lock "cinder-quobyte-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063" acquired by "delete_volume" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:52 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47181f1-f997-4de7-8fba-b5a06168e1bf]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:52 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063 Nov 02 10:45:52 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:52 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2317ac92-6c11-428e-b96c-10a9ebc3d866 tempest-AttachVolumeNegativeTest-1125873498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4" returned: 0 in 0.619s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2317ac92-6c11-428e-b96c-10a9ebc3d866 tempest-AttachVolumeNegativeTest-1125873498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:52 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4 Nov 02 10:45:52 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:52 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063" returned: 0 in 0.673s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:52 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063 Nov 02 10:45:52 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:52 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2317ac92-6c11-428e-b96c-10a9ebc3d866 tempest-AttachVolumeNegativeTest-1125873498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4" returned: 0 in 0.382s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2317ac92-6c11-428e-b96c-10a9ebc3d866 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "cinder-quobyte-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4" released by "delete_volume" :: held 1.070s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:52 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-2317ac92-6c11-428e-b96c-10a9ebc3d866 tempest-AttachVolumeNegativeTest-1125873498 None] Created reservations ['f66e1f87-d9d6-4f71-81ae-d56514bdec53', 'e44a95d4-5891-43e7-a30e-1265e8a3e88f', '4914d4f6-40e1-419e-b03f-8247c5c7c2e1', '9e1967ae-78f6-4ff7-b5d3-82800cce9c36'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2317ac92-6c11-428e-b96c-10a9ebc3d866 tempest-AttachVolumeNegativeTest-1125873498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2317ac92-6c11-428e-b96c-10a9ebc3d866 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2317ac92-6c11-428e-b96c-10a9ebc3d866 tempest-AttachVolumeNegativeTest-1125873498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2317ac92-6c11-428e-b96c-10a9ebc3d866 tempest-AttachVolumeNegativeTest-1125873498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2317ac92-6c11-428e-b96c-10a9ebc3d866 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2317ac92-6c11-428e-b96c-10a9ebc3d866 tempest-AttachVolumeNegativeTest-1125873498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:53 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:53 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:45:53 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063" returned: 0 in 0.388s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Lock "cinder-quobyte-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063" released by "delete_volume" :: held 1.143s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:53 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:45:53 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:53 devstack cinder-volume[87084]: WARNING cinder.quota [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:45:53 devstack cinder-volume[87084]: WARNING cinder.quota [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Created reservations ['78a5fced-b4af-4848-89c5-5770da3389e8', '0fa6d724-0741-4530-863a-681c08bba368', '795c3649-6f11-471e-8a83-df60529e2ca9', '4bb75755-c95f-41ee-809a-0ddc83dd9c58'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:53 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2317ac92-6c11-428e-b96c-10a9ebc3d866 tempest-AttachVolumeNegativeTest-1125873498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.354s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-2317ac92-6c11-428e-b96c-10a9ebc3d866 tempest-AttachVolumeNegativeTest-1125873498 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:53 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2317ac92-6c11-428e-b96c-10a9ebc3d866 tempest-AttachVolumeNegativeTest-1125873498 None] Deleted volume successfully. Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2317ac92-6c11-428e-b96c-10a9ebc3d866 tempest-AttachVolumeNegativeTest-1125873498 None] Lock "cinder-c2ec3f82-c0c5-4164-9a0e-e874cf99dee4-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:53 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:45:53 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:53 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.449s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:45:53 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.335s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:53 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Deleted volume successfully. Nov 02 10:45:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d55cb8f8-4906-4658-a331-ea979c9ea8e0 tempest-VolumeRetypeWithoutMigrationTest-1255064760 None] Lock "cinder-107aa9aa-a0ae-4687-b5f3-3fd0a9a77063-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Flow 'volume_create_manager' (7a302754-b15b-4978-9760-136b7dbcb245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80f2694-42d8-41c0-ae09-bf51cb9ca3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80f2694-42d8-41c0-ae09-bf51cb9ca3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-42342855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87abeed7-5d03-4839-859a-8cfbaaecc200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b1ea247a963462ca8090bd323cf5e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:57Z,use_quota=True,user_id='b2c2ed4c82fd43858dcf4ad3bd71affb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817b32b1-646a-4e5e-b90a-ff36e6772fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817b32b1-646a-4e5e-b90a-ff36e6772fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074fa6d6-3d1b-471c-9aa6-116f14b99a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074fa6d6-3d1b-471c-9aa6-116f14b99a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87abeed7-5d03-4839-859a-8cfbaaecc200', 'volume_name': 'volume-87abeed7-5d03-4839-859a-8cfbaaecc200', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d099b211-b89d-4422-a7e6-9033b16f4d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d099b211-b89d-4422-a7e6-9033b16f4d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02b8542-f2be-4034-b62d-53a5e4d38664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:57 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Volume 87abeed7-5d03-4839-859a-8cfbaaecc200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87abeed7-5d03-4839-859a-8cfbaaecc200', 'volume_size': 1} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-42342855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87abeed7-5d03-4839-859a-8cfbaaecc200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b1ea247a963462ca8090bd323cf5e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:57Z,use_quota=True,user_id='b2c2ed4c82fd43858dcf4ad3bd71affb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Creating volume 87abeed7-5d03-4839-859a-8cfbaaecc200 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:45:57 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:45:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87abeed7-5d03-4839-859a-8cfbaaecc200 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:57 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87abeed7-5d03-4839-859a-8cfbaaecc200 1073741824 Nov 02 10:45:57 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:58 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87abeed7-5d03-4839-859a-8cfbaaecc200 1073741824" returned: 0 in 0.554s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87abeed7-5d03-4839-859a-8cfbaaecc200 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:58 devstack sudo[95548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87abeed7-5d03-4839-859a-8cfbaaecc200 Nov 02 10:45:58 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:58 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87abeed7-5d03-4839-859a-8cfbaaecc200" returned: 0 in 0.347s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:45:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02b8542-f2be-4034-b62d-53a5e4d38664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87abeed7-5d03-4839-859a-8cfbaaecc200', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (affa2821-2fbc-4c1e-95c3-851e634c4467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:58 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Volume volume-87abeed7-5d03-4839-859a-8cfbaaecc200 (87abeed7-5d03-4839-859a-8cfbaaecc200): created successfully Nov 02 10:45:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (affa2821-2fbc-4c1e-95c3-851e634c4467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Flow 'volume_create_manager' (7a302754-b15b-4978-9760-136b7dbcb245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:58 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-79464c41-1890-446e-89ac-f6cf7b6f9606 tempest-VolumesMetadataTest-2075328158 None] Created volume successfully. Nov 02 10:46:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0d1ec1c7-f3f1-4054-9606-0464819801b0 tempest-VolumesMetadataTest-2075328158 None] Acquiring lock "cinder-87abeed7-5d03-4839-859a-8cfbaaecc200-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0d1ec1c7-f3f1-4054-9606-0464819801b0 tempest-VolumesMetadataTest-2075328158 None] Lock "cinder-87abeed7-5d03-4839-859a-8cfbaaecc200-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0d1ec1c7-f3f1-4054-9606-0464819801b0 tempest-VolumesMetadataTest-2075328158 None] Acquiring lock "cinder-quobyte-87abeed7-5d03-4839-859a-8cfbaaecc200" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0d1ec1c7-f3f1-4054-9606-0464819801b0 tempest-VolumesMetadataTest-2075328158 None] Lock "cinder-quobyte-87abeed7-5d03-4839-859a-8cfbaaecc200" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:00 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f2838e-babe-4838-ad0a-27efe14c3849]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0d1ec1c7-f3f1-4054-9606-0464819801b0 tempest-VolumesMetadataTest-2075328158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87abeed7-5d03-4839-859a-8cfbaaecc200 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:00 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87abeed7-5d03-4839-859a-8cfbaaecc200 Nov 02 10:46:00 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:01 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0d1ec1c7-f3f1-4054-9606-0464819801b0 tempest-VolumesMetadataTest-2075328158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87abeed7-5d03-4839-859a-8cfbaaecc200" returned: 0 in 0.412s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0d1ec1c7-f3f1-4054-9606-0464819801b0 tempest-VolumesMetadataTest-2075328158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87abeed7-5d03-4839-859a-8cfbaaecc200 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:01 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87abeed7-5d03-4839-859a-8cfbaaecc200 Nov 02 10:46:01 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:01 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0d1ec1c7-f3f1-4054-9606-0464819801b0 tempest-VolumesMetadataTest-2075328158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-87abeed7-5d03-4839-859a-8cfbaaecc200" returned: 0 in 0.265s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0d1ec1c7-f3f1-4054-9606-0464819801b0 tempest-VolumesMetadataTest-2075328158 None] Lock "cinder-quobyte-87abeed7-5d03-4839-859a-8cfbaaecc200" released by "delete_volume" :: held 0.737s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:01 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-0d1ec1c7-f3f1-4054-9606-0464819801b0 tempest-VolumesMetadataTest-2075328158 None] Created reservations ['345f725f-8b82-4bf9-aed5-1060fba0db92', 'd2232b77-74e2-4a16-a0a1-d4a987a1140b', '8fbc563b-b713-4d7a-8fc2-4f01126df41b', '9210fe9d-1ad2-461e-a96a-0913f47bebd7'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0d1ec1c7-f3f1-4054-9606-0464819801b0 tempest-VolumesMetadataTest-2075328158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0d1ec1c7-f3f1-4054-9606-0464819801b0 tempest-VolumesMetadataTest-2075328158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0d1ec1c7-f3f1-4054-9606-0464819801b0 tempest-VolumesMetadataTest-2075328158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0d1ec1c7-f3f1-4054-9606-0464819801b0 tempest-VolumesMetadataTest-2075328158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0d1ec1c7-f3f1-4054-9606-0464819801b0 tempest-VolumesMetadataTest-2075328158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0d1ec1c7-f3f1-4054-9606-0464819801b0 tempest-VolumesMetadataTest-2075328158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:01 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:46:01 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:01 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0d1ec1c7-f3f1-4054-9606-0464819801b0 tempest-VolumesMetadataTest-2075328158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.286s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:01 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-0d1ec1c7-f3f1-4054-9606-0464819801b0 tempest-VolumesMetadataTest-2075328158 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:01 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0d1ec1c7-f3f1-4054-9606-0464819801b0 tempest-VolumesMetadataTest-2075328158 None] Deleted volume successfully. Nov 02 10:46:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0d1ec1c7-f3f1-4054-9606-0464819801b0 tempest-VolumesMetadataTest-2075328158 None] Lock "cinder-87abeed7-5d03-4839-859a-8cfbaaecc200-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Flow 'volume_create_manager' (2f1cc42f-c968-4ec2-9b1d-14c13967eb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6d975e-b6d4-48fe-a0fb-dabbb613c5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6d975e-b6d4-48fe-a0fb-dabbb613c5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-897875725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1278c2b-adbb-4259-97ff-3a45bf75c888,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1036a26c0e244f5e8238f49391d8f78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:09Z,use_quota=True,user_id='1b3220900680406182b9f8cf1f9ec34b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fbaabc-c119-4a40-9fe9-366d893882e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fbaabc-c119-4a40-9fe9-366d893882e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432b02ec-384b-45be-96bc-606ea5f9227b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432b02ec-384b-45be-96bc-606ea5f9227b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1278c2b-adbb-4259-97ff-3a45bf75c888', 'volume_name': 'volume-e1278c2b-adbb-4259-97ff-3a45bf75c888', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2fb308-6a1f-4e2a-acef-a24e33164bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2fb308-6a1f-4e2a-acef-a24e33164bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9651ee3-861e-4279-8ef4-372d2c70d500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:08 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Volume e1278c2b-adbb-4259-97ff-3a45bf75c888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1278c2b-adbb-4259-97ff-3a45bf75c888', 'volume_size': 1} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-897875725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1278c2b-adbb-4259-97ff-3a45bf75c888,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1036a26c0e244f5e8238f49391d8f78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:09Z,use_quota=True,user_id='1b3220900680406182b9f8cf1f9ec34b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Creating volume e1278c2b-adbb-4259-97ff-3a45bf75c888 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:08 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:46:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e1278c2b-adbb-4259-97ff-3a45bf75c888 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:08 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e1278c2b-adbb-4259-97ff-3a45bf75c888 1073741824 Nov 02 10:46:08 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:09 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e1278c2b-adbb-4259-97ff-3a45bf75c888 1073741824" returned: 0 in 0.629s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e1278c2b-adbb-4259-97ff-3a45bf75c888 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:09 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e1278c2b-adbb-4259-97ff-3a45bf75c888 Nov 02 10:46:09 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:09 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e1278c2b-adbb-4259-97ff-3a45bf75c888" returned: 0 in 0.359s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9651ee3-861e-4279-8ef4-372d2c70d500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1278c2b-adbb-4259-97ff-3a45bf75c888', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f80f46a-78a9-4416-b053-074ccd0cc306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:10 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Volume volume-e1278c2b-adbb-4259-97ff-3a45bf75c888 (e1278c2b-adbb-4259-97ff-3a45bf75c888): created successfully Nov 02 10:46:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f80f46a-78a9-4416-b053-074ccd0cc306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Flow 'volume_create_manager' (2f1cc42f-c968-4ec2-9b1d-14c13967eb59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:10 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-1f1ff57f-e686-42ad-a910-724aadfe10ab req-491dbaa0-d1da-4f1b-b950-ab26ae6a48af tempest-VolumesGetTestJSON-1900680166 None] Created volume successfully. Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Flow 'volume_create_manager' (e8eadb03-54e5-4424-93d1-d28b7fabbb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3467048c-4a55-4a97-90a4-1994ebe4f5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3467048c-4a55-4a97-90a4-1994ebe4f5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-534839787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9fecdf0-93ca-485a-92f0-5ac918156ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e13f7804141344e8881b39206b3cc04c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:11Z,use_quota=True,user_id='ee29a2d70e7c4f818d43e40a7118cb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47577b3c-61fb-4ad7-ab0f-827fe6be16b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47577b3c-61fb-4ad7-ab0f-827fe6be16b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a451bbdc-c98a-4d40-acfe-36ccecd2e5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a451bbdc-c98a-4d40-acfe-36ccecd2e5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9fecdf0-93ca-485a-92f0-5ac918156ae7', 'volume_name': 'volume-c9fecdf0-93ca-485a-92f0-5ac918156ae7', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06769cbf-48cd-47c6-a07d-ee537174725a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06769cbf-48cd-47c6-a07d-ee537174725a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510bf13f-d081-42a3-88ab-25fb48aca525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:11 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Volume c9fecdf0-93ca-485a-92f0-5ac918156ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9fecdf0-93ca-485a-92f0-5ac918156ae7', 'volume_size': 1} Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-534839787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9fecdf0-93ca-485a-92f0-5ac918156ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e13f7804141344e8881b39206b3cc04c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:11Z,use_quota=True,user_id='ee29a2d70e7c4f818d43e40a7118cb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Creating volume c9fecdf0-93ca-485a-92f0-5ac918156ae7 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:11 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:46:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c9fecdf0-93ca-485a-92f0-5ac918156ae7 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:11 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c9fecdf0-93ca-485a-92f0-5ac918156ae7 1073741824 Nov 02 10:46:11 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ab53d000-7139-4163-8842-44d9e7d9f74b req-37f6f18f-78ca-41b4-8178-36dc3d6d6f2c tempest-VolumesGetTestJSON-1900680166 None] Acquiring lock "cinder-e1278c2b-adbb-4259-97ff-3a45bf75c888-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ab53d000-7139-4163-8842-44d9e7d9f74b req-37f6f18f-78ca-41b4-8178-36dc3d6d6f2c tempest-VolumesGetTestJSON-1900680166 None] Lock "cinder-e1278c2b-adbb-4259-97ff-3a45bf75c888-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ab53d000-7139-4163-8842-44d9e7d9f74b req-37f6f18f-78ca-41b4-8178-36dc3d6d6f2c tempest-VolumesGetTestJSON-1900680166 None] Acquiring lock "cinder-quobyte-e1278c2b-adbb-4259-97ff-3a45bf75c888" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ab53d000-7139-4163-8842-44d9e7d9f74b req-37f6f18f-78ca-41b4-8178-36dc3d6d6f2c tempest-VolumesGetTestJSON-1900680166 None] Lock "cinder-quobyte-e1278c2b-adbb-4259-97ff-3a45bf75c888" acquired by "delete_volume" :: waited 0.041s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:12 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c9fecdf0-93ca-485a-92f0-5ac918156ae7 1073741824" returned: 0 in 0.804s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:12 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9c6d5c-da57-4fd9-8c9b-b05e543910a9]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-ab53d000-7139-4163-8842-44d9e7d9f74b req-37f6f18f-78ca-41b4-8178-36dc3d6d6f2c tempest-VolumesGetTestJSON-1900680166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e1278c2b-adbb-4259-97ff-3a45bf75c888 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c9fecdf0-93ca-485a-92f0-5ac918156ae7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:12 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c9fecdf0-93ca-485a-92f0-5ac918156ae7 Nov 02 10:46:12 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:12 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e1278c2b-adbb-4259-97ff-3a45bf75c888 Nov 02 10:46:12 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:12 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c9fecdf0-93ca-485a-92f0-5ac918156ae7" returned: 0 in 0.325s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510bf13f-d081-42a3-88ab-25fb48aca525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9fecdf0-93ca-485a-92f0-5ac918156ae7', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed522e6b-a946-4c15-a9e1-00d8dbc66ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:12 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Volume volume-c9fecdf0-93ca-485a-92f0-5ac918156ae7 (c9fecdf0-93ca-485a-92f0-5ac918156ae7): created successfully Nov 02 10:46:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed522e6b-a946-4c15-a9e1-00d8dbc66ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Flow 'volume_create_manager' (e8eadb03-54e5-4424-93d1-d28b7fabbb55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:12 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1a2a7bde-5819-4d25-a49f-9b4a91363884 tempest-VolumesTransfersTest-486926771 None] Created volume successfully. Nov 02 10:46:13 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-ab53d000-7139-4163-8842-44d9e7d9f74b req-37f6f18f-78ca-41b4-8178-36dc3d6d6f2c tempest-VolumesGetTestJSON-1900680166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e1278c2b-adbb-4259-97ff-3a45bf75c888" returned: 0 in 0.813s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-ab53d000-7139-4163-8842-44d9e7d9f74b req-37f6f18f-78ca-41b4-8178-36dc3d6d6f2c tempest-VolumesGetTestJSON-1900680166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e1278c2b-adbb-4259-97ff-3a45bf75c888 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:13 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e1278c2b-adbb-4259-97ff-3a45bf75c888 Nov 02 10:46:13 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:13 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-ab53d000-7139-4163-8842-44d9e7d9f74b req-37f6f18f-78ca-41b4-8178-36dc3d6d6f2c tempest-VolumesGetTestJSON-1900680166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e1278c2b-adbb-4259-97ff-3a45bf75c888" returned: 0 in 0.391s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ab53d000-7139-4163-8842-44d9e7d9f74b req-37f6f18f-78ca-41b4-8178-36dc3d6d6f2c tempest-VolumesGetTestJSON-1900680166 None] Lock "cinder-quobyte-e1278c2b-adbb-4259-97ff-3a45bf75c888" released by "delete_volume" :: held 1.332s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:13 devstack cinder-volume[87084]: DEBUG cinder.quota [req-ab53d000-7139-4163-8842-44d9e7d9f74b req-37f6f18f-78ca-41b4-8178-36dc3d6d6f2c tempest-VolumesGetTestJSON-1900680166 None] Created reservations ['4af0261d-5b02-4801-b8b1-e34116374a05', 'e33b2724-b8b8-49f2-a433-9efe601c2e6f', '23d3f352-940b-405c-a53a-980e6b0a4158', 'e7e15080-346c-4613-ba87-f50c8da4d09c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-ab53d000-7139-4163-8842-44d9e7d9f74b req-37f6f18f-78ca-41b4-8178-36dc3d6d6f2c tempest-VolumesGetTestJSON-1900680166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-ab53d000-7139-4163-8842-44d9e7d9f74b req-37f6f18f-78ca-41b4-8178-36dc3d6d6f2c tempest-VolumesGetTestJSON-1900680166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-ab53d000-7139-4163-8842-44d9e7d9f74b req-37f6f18f-78ca-41b4-8178-36dc3d6d6f2c tempest-VolumesGetTestJSON-1900680166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-ab53d000-7139-4163-8842-44d9e7d9f74b req-37f6f18f-78ca-41b4-8178-36dc3d6d6f2c tempest-VolumesGetTestJSON-1900680166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-ab53d000-7139-4163-8842-44d9e7d9f74b req-37f6f18f-78ca-41b4-8178-36dc3d6d6f2c tempest-VolumesGetTestJSON-1900680166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-ab53d000-7139-4163-8842-44d9e7d9f74b req-37f6f18f-78ca-41b4-8178-36dc3d6d6f2c tempest-VolumesGetTestJSON-1900680166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:13 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:46:13 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:14 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-ab53d000-7139-4163-8842-44d9e7d9f74b req-37f6f18f-78ca-41b4-8178-36dc3d6d6f2c tempest-VolumesGetTestJSON-1900680166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.371s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:14 devstack cinder-volume[87084]: DEBUG cinder.manager [req-ab53d000-7139-4163-8842-44d9e7d9f74b req-37f6f18f-78ca-41b4-8178-36dc3d6d6f2c tempest-VolumesGetTestJSON-1900680166 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-ab53d000-7139-4163-8842-44d9e7d9f74b req-37f6f18f-78ca-41b4-8178-36dc3d6d6f2c tempest-VolumesGetTestJSON-1900680166 None] Deleted volume successfully. Nov 02 10:46:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ab53d000-7139-4163-8842-44d9e7d9f74b req-37f6f18f-78ca-41b4-8178-36dc3d6d6f2c tempest-VolumesGetTestJSON-1900680166 None] Lock "cinder-e1278c2b-adbb-4259-97ff-3a45bf75c888-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-68f340d4-9b26-41ac-805e-8f30804dcd95 tempest-VolumesTransfersTest-1738912487 None] Transfer volume completed successfully. Nov 02 10:46:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-735a3efb-f8b1-48cc-bf8a-9bf12a911c26 tempest-VolumesTransfersTest-1136131171 None] Acquiring lock "cinder-c9fecdf0-93ca-485a-92f0-5ac918156ae7-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-735a3efb-f8b1-48cc-bf8a-9bf12a911c26 tempest-VolumesTransfersTest-1136131171 None] Lock "cinder-c9fecdf0-93ca-485a-92f0-5ac918156ae7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-735a3efb-f8b1-48cc-bf8a-9bf12a911c26 tempest-VolumesTransfersTest-1136131171 None] Acquiring lock "cinder-quobyte-c9fecdf0-93ca-485a-92f0-5ac918156ae7" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-735a3efb-f8b1-48cc-bf8a-9bf12a911c26 tempest-VolumesTransfersTest-1136131171 None] Lock "cinder-quobyte-c9fecdf0-93ca-485a-92f0-5ac918156ae7" acquired by "delete_volume" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:16 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e297fa73-5e17-40ca-8ab1-c5babc72dbe4]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-735a3efb-f8b1-48cc-bf8a-9bf12a911c26 tempest-VolumesTransfersTest-1136131171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c9fecdf0-93ca-485a-92f0-5ac918156ae7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:16 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c9fecdf0-93ca-485a-92f0-5ac918156ae7 Nov 02 10:46:16 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:16 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-735a3efb-f8b1-48cc-bf8a-9bf12a911c26 tempest-VolumesTransfersTest-1136131171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c9fecdf0-93ca-485a-92f0-5ac918156ae7" returned: 0 in 0.628s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-735a3efb-f8b1-48cc-bf8a-9bf12a911c26 tempest-VolumesTransfersTest-1136131171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c9fecdf0-93ca-485a-92f0-5ac918156ae7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:16 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c9fecdf0-93ca-485a-92f0-5ac918156ae7 Nov 02 10:46:16 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:17 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-735a3efb-f8b1-48cc-bf8a-9bf12a911c26 tempest-VolumesTransfersTest-1136131171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c9fecdf0-93ca-485a-92f0-5ac918156ae7" returned: 0 in 0.389s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-735a3efb-f8b1-48cc-bf8a-9bf12a911c26 tempest-VolumesTransfersTest-1136131171 None] Lock "cinder-quobyte-c9fecdf0-93ca-485a-92f0-5ac918156ae7" released by "delete_volume" :: held 1.117s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:17 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=109,cinder:UPDATE=126,cinder:INSERT=33,cinder:DELETE=8 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:46:17 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=104,cinder:DELETE=12,cinder:INSERT=30,cinder:UPDATE=141 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:46:17 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-735a3efb-f8b1-48cc-bf8a-9bf12a911c26 tempest-VolumesTransfersTest-1136131171 None] Created reservations ['36fff903-8c21-47be-aa62-b1f0d40deede', 'fd635284-39a8-49cd-a9f0-491875e3352e', '50be48df-edcd-4da4-b191-6550fbfa60bb', '82123520-200e-4254-8296-86cdc27064bd'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-735a3efb-f8b1-48cc-bf8a-9bf12a911c26 tempest-VolumesTransfersTest-1136131171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-735a3efb-f8b1-48cc-bf8a-9bf12a911c26 tempest-VolumesTransfersTest-1136131171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-735a3efb-f8b1-48cc-bf8a-9bf12a911c26 tempest-VolumesTransfersTest-1136131171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-735a3efb-f8b1-48cc-bf8a-9bf12a911c26 tempest-VolumesTransfersTest-1136131171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-735a3efb-f8b1-48cc-bf8a-9bf12a911c26 tempest-VolumesTransfersTest-1136131171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-735a3efb-f8b1-48cc-bf8a-9bf12a911c26 tempest-VolumesTransfersTest-1136131171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:17 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:46:17 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:18 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-735a3efb-f8b1-48cc-bf8a-9bf12a911c26 tempest-VolumesTransfersTest-1136131171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.526s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:18 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-735a3efb-f8b1-48cc-bf8a-9bf12a911c26 tempest-VolumesTransfersTest-1136131171 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:18 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-735a3efb-f8b1-48cc-bf8a-9bf12a911c26 tempest-VolumesTransfersTest-1136131171 None] Deleted volume successfully. Nov 02 10:46:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-735a3efb-f8b1-48cc-bf8a-9bf12a911c26 tempest-VolumesTransfersTest-1136131171 None] Lock "cinder-c9fecdf0-93ca-485a-92f0-5ac918156ae7-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Flow 'volume_create_manager' (b54a5e90-fa6a-4ca0-9396-c8b088c6238a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c172127-064c-4907-8431-bbe1566c8658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c172127-064c-4907-8431-bbe1566c8658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-159648335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd5828e4-ec45-4168-a58d-9f35e2e08035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e13f7804141344e8881b39206b3cc04c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:20Z,use_quota=True,user_id='ee29a2d70e7c4f818d43e40a7118cb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (157f3377-c448-4db0-a0c0-6c6dbd36bcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (157f3377-c448-4db0-a0c0-6c6dbd36bcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d2a73a-c63b-4376-a78c-853c923d8fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d2a73a-c63b-4376-a78c-853c923d8fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd5828e4-ec45-4168-a58d-9f35e2e08035', 'volume_name': 'volume-cd5828e4-ec45-4168-a58d-9f35e2e08035', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe612f6-3042-41f1-8266-0e2b3450487e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe612f6-3042-41f1-8266-0e2b3450487e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d773f3-434b-4182-818d-52fdef48146c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:19 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Volume cd5828e4-ec45-4168-a58d-9f35e2e08035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd5828e4-ec45-4168-a58d-9f35e2e08035', 'volume_size': 1} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-159648335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd5828e4-ec45-4168-a58d-9f35e2e08035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e13f7804141344e8881b39206b3cc04c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:20Z,use_quota=True,user_id='ee29a2d70e7c4f818d43e40a7118cb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Creating volume cd5828e4-ec45-4168-a58d-9f35e2e08035 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:19 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:46:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-cd5828e4-ec45-4168-a58d-9f35e2e08035 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:19 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-cd5828e4-ec45-4168-a58d-9f35e2e08035 1073741824 Nov 02 10:46:19 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:20 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-cd5828e4-ec45-4168-a58d-9f35e2e08035 1073741824" returned: 0 in 0.689s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-cd5828e4-ec45-4168-a58d-9f35e2e08035 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:20 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-cd5828e4-ec45-4168-a58d-9f35e2e08035 Nov 02 10:46:20 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:21 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-cd5828e4-ec45-4168-a58d-9f35e2e08035" returned: 0 in 0.513s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d773f3-434b-4182-818d-52fdef48146c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd5828e4-ec45-4168-a58d-9f35e2e08035', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cebdba10-dc30-469e-85af-d00cd7cfb8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:21 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Volume volume-cd5828e4-ec45-4168-a58d-9f35e2e08035 (cd5828e4-ec45-4168-a58d-9f35e2e08035): created successfully Nov 02 10:46:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cebdba10-dc30-469e-85af-d00cd7cfb8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Flow 'volume_create_manager' (b54a5e90-fa6a-4ca0-9396-c8b088c6238a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:21 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1a6e0c62-b15a-4643-9955-25397b0508ca tempest-VolumesTransfersTest-486926771 None] Created volume successfully. Nov 02 10:46:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fa5fe364-7a28-4871-bad2-4f92e7273521 tempest-VolumesTransfersTest-1136131171 None] Acquiring lock "cinder-cd5828e4-ec45-4168-a58d-9f35e2e08035-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fa5fe364-7a28-4871-bad2-4f92e7273521 tempest-VolumesTransfersTest-1136131171 None] Lock "cinder-cd5828e4-ec45-4168-a58d-9f35e2e08035-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fa5fe364-7a28-4871-bad2-4f92e7273521 tempest-VolumesTransfersTest-1136131171 None] Acquiring lock "cinder-quobyte-cd5828e4-ec45-4168-a58d-9f35e2e08035" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fa5fe364-7a28-4871-bad2-4f92e7273521 tempest-VolumesTransfersTest-1136131171 None] Lock "cinder-quobyte-cd5828e4-ec45-4168-a58d-9f35e2e08035" acquired by "delete_volume" :: waited 0.039s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[58de2f47-f1f8-4b82-b1cf-df95efb7c367]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa5fe364-7a28-4871-bad2-4f92e7273521 tempest-VolumesTransfersTest-1136131171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-cd5828e4-ec45-4168-a58d-9f35e2e08035 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Flow 'volume_create_manager' (87fa10ca-7909-4e8d-b19c-d78d1a9a0285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3023b365-0d60-4ddc-8a94-951c1b7df196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3023b365-0d60-4ddc-8a94-951c1b7df196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-502495952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751c6b59-acb9-4c54-ba21-2b3520de1e90,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f838f7b357b4ece8c5b745234ac8dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:24Z,use_quota=True,user_id='b36da955ccf144baabe1fb6d620f024f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0716f3-ae23-4a8a-aeb6-bf15e5372eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0716f3-ae23-4a8a-aeb6-bf15e5372eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444808f1-f5af-4563-9add-223f7d5771ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444808f1-f5af-4563-9add-223f7d5771ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '751c6b59-acb9-4c54-ba21-2b3520de1e90', 'volume_name': 'volume-751c6b59-acb9-4c54-ba21-2b3520de1e90', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0831d6d7-909f-45eb-b8a6-7f46de8e1016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0831d6d7-909f-45eb-b8a6-7f46de8e1016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb80db9-c615-4a73-9c5e-4ccce9eda2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:24 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Volume 751c6b59-acb9-4c54-ba21-2b3520de1e90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-751c6b59-acb9-4c54-ba21-2b3520de1e90', 'volume_size': 1} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-502495952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751c6b59-acb9-4c54-ba21-2b3520de1e90,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f838f7b357b4ece8c5b745234ac8dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:24Z,use_quota=True,user_id='b36da955ccf144baabe1fb6d620f024f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Creating volume 751c6b59-acb9-4c54-ba21-2b3520de1e90 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:24 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:46:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-751c6b59-acb9-4c54-ba21-2b3520de1e90 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:24 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-cd5828e4-ec45-4168-a58d-9f35e2e08035 Nov 02 10:46:24 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:24 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-751c6b59-acb9-4c54-ba21-2b3520de1e90 1073741824 Nov 02 10:46:24 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:25 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa5fe364-7a28-4871-bad2-4f92e7273521 tempest-VolumesTransfersTest-1136131171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-cd5828e4-ec45-4168-a58d-9f35e2e08035" returned: 0 in 1.335s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa5fe364-7a28-4871-bad2-4f92e7273521 tempest-VolumesTransfersTest-1136131171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-cd5828e4-ec45-4168-a58d-9f35e2e08035 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:25 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-cd5828e4-ec45-4168-a58d-9f35e2e08035 Nov 02 10:46:25 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:25 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-751c6b59-acb9-4c54-ba21-2b3520de1e90 1073741824" returned: 0 in 1.492s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:25 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa5fe364-7a28-4871-bad2-4f92e7273521 tempest-VolumesTransfersTest-1136131171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-cd5828e4-ec45-4168-a58d-9f35e2e08035" returned: 0 in 0.509s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fa5fe364-7a28-4871-bad2-4f92e7273521 tempest-VolumesTransfersTest-1136131171 None] Lock "cinder-quobyte-cd5828e4-ec45-4168-a58d-9f35e2e08035" released by "delete_volume" :: held 2.002s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-751c6b59-acb9-4c54-ba21-2b3520de1e90 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:26 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-751c6b59-acb9-4c54-ba21-2b3520de1e90 Nov 02 10:46:26 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:26 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-fa5fe364-7a28-4871-bad2-4f92e7273521 tempest-VolumesTransfersTest-1136131171 None] Created reservations ['73470fbb-ccce-499d-b914-9dd4ff0e9dc9', '8293435a-ad42-40d1-85af-97f877f3f411', 'b8f4bc58-c480-475e-ae3a-475dfa131735', 'd1adef98-e867-4238-ab96-47e1f679c590'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fa5fe364-7a28-4871-bad2-4f92e7273521 tempest-VolumesTransfersTest-1136131171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fa5fe364-7a28-4871-bad2-4f92e7273521 tempest-VolumesTransfersTest-1136131171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fa5fe364-7a28-4871-bad2-4f92e7273521 tempest-VolumesTransfersTest-1136131171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fa5fe364-7a28-4871-bad2-4f92e7273521 tempest-VolumesTransfersTest-1136131171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fa5fe364-7a28-4871-bad2-4f92e7273521 tempest-VolumesTransfersTest-1136131171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa5fe364-7a28-4871-bad2-4f92e7273521 tempest-VolumesTransfersTest-1136131171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:26 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:46:26 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:26 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-751c6b59-acb9-4c54-ba21-2b3520de1e90" returned: 0 in 0.429s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.074s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb80db9-c615-4a73-9c5e-4ccce9eda2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-751c6b59-acb9-4c54-ba21-2b3520de1e90', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bcecfa-178b-4884-b3c5-c14c667482e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:26 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Volume volume-751c6b59-acb9-4c54-ba21-2b3520de1e90 (751c6b59-acb9-4c54-ba21-2b3520de1e90): created successfully Nov 02 10:46:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bcecfa-178b-4884-b3c5-c14c667482e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Flow 'volume_create_manager' (87fa10ca-7909-4e8d-b19c-d78d1a9a0285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:26 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e30395e4-31f4-4ea9-ac1c-3d11d674bdbd tempest-VolumesTestJSON-622930993 None] Created volume successfully. Nov 02 10:46:26 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa5fe364-7a28-4871-bad2-4f92e7273521 tempest-VolumesTransfersTest-1136131171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.383s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:26 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-fa5fe364-7a28-4871-bad2-4f92e7273521 tempest-VolumesTransfersTest-1136131171 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:26 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-fa5fe364-7a28-4871-bad2-4f92e7273521 tempest-VolumesTransfersTest-1136131171 None] Deleted volume successfully. Nov 02 10:46:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fa5fe364-7a28-4871-bad2-4f92e7273521 tempest-VolumesTransfersTest-1136131171 None] Lock "cinder-cd5828e4-ec45-4168-a58d-9f35e2e08035-delete_volume" released by "delete_volume" :: held 2.855s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Flow 'volume_create_manager' (0f7bbd94-ca16-4e95-a183-b9dcf08fca2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71206673-744b-45a5-9a80-5644356217e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71206673-744b-45a5-9a80-5644356217e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1594744019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f838f7b357b4ece8c5b745234ac8dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:28Z,use_quota=True,user_id='b36da955ccf144baabe1fb6d620f024f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044c6cbb-855c-4000-8f3a-eca2de088439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044c6cbb-855c-4000-8f3a-eca2de088439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c39fb59-cb84-40df-af68-bb62505b3f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c39fb59-cb84-40df-af68-bb62505b3f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb', 'volume_name': 'volume-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bceb366e-da9c-4c16-b165-e2abd7b182e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bceb366e-da9c-4c16-b165-e2abd7b182e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec219930-0740-472a-acd9-e2a981f10ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:28 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Volume 91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb', 'volume_size': 1} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1594744019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f838f7b357b4ece8c5b745234ac8dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:28Z,use_quota=True,user_id='b36da955ccf144baabe1fb6d620f024f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Creating volume 91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:28 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:46:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:28 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb 1073741824 Nov 02 10:46:28 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:29 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb 1073741824" returned: 0 in 0.729s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:29 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb Nov 02 10:46:29 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:29 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb" returned: 0 in 0.468s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec219930-0740-472a-acd9-e2a981f10ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3169c94-7891-4934-89a6-73f18d9209ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:29 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Volume volume-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb (91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb): created successfully Nov 02 10:46:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3169c94-7891-4934-89a6-73f18d9209ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Flow 'volume_create_manager' (0f7bbd94-ca16-4e95-a183-b9dcf08fca2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2e67ed4e-9ddb-4ba0-8813-b126882aaa3f tempest-VolumesTestJSON-622930993 None] Created volume successfully. Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Flow 'volume_create_manager' (e8948ec5-3538-4a79-b7d5-cf9a964f5c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3f3474-6afa-4885-be71-7f1ca25c750b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3f3474-6afa-4885-be71-7f1ca25c750b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-290291642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c186a7-e107-4f60-a43c-50c4f7ae9524,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f838f7b357b4ece8c5b745234ac8dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:31Z,use_quota=True,user_id='b36da955ccf144baabe1fb6d620f024f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79f4a690-7e19-4008-a4f0-bfe65221c64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79f4a690-7e19-4008-a4f0-bfe65221c64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2c1aae-005b-4a5c-bec7-4f81a3b80254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2c1aae-005b-4a5c-bec7-4f81a3b80254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c186a7-e107-4f60-a43c-50c4f7ae9524', 'volume_name': 'volume-d0c186a7-e107-4f60-a43c-50c4f7ae9524', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d9c4b2-0cc0-459d-8147-b6a6c8a4e0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d9c4b2-0cc0-459d-8147-b6a6c8a4e0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb8c145-db31-4df0-b93b-ff56418853ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:31 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Volume d0c186a7-e107-4f60-a43c-50c4f7ae9524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c186a7-e107-4f60-a43c-50c4f7ae9524', 'volume_size': 1} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-290291642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c186a7-e107-4f60-a43c-50c4f7ae9524,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f838f7b357b4ece8c5b745234ac8dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:31Z,use_quota=True,user_id='b36da955ccf144baabe1fb6d620f024f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Creating volume d0c186a7-e107-4f60-a43c-50c4f7ae9524 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:31 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d0c186a7-e107-4f60-a43c-50c4f7ae9524 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:31 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d0c186a7-e107-4f60-a43c-50c4f7ae9524 1073741824 Nov 02 10:46:31 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Flow 'volume_create_manager' (b0b0e516-52ca-4f88-814f-7cd7fa1d8c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4174ff0-cc93-4ba6-8c7b-16eebd1e5978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4174ff0-cc93-4ba6-8c7b-16eebd1e5978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-936258267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3a9ea2-67a5-4caa-8b3f-34b532c216ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e78c44ca78e4fea8f7f42bbc1eaf5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:32Z,use_quota=True,user_id='cc34c259f11044a39b94499398dd89fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113759b5-22fb-477e-8ba0-ba8b9e6d9db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113759b5-22fb-477e-8ba0-ba8b9e6d9db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a48ec100-90a6-41cc-adfe-555db51fcee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a48ec100-90a6-41cc-adfe-555db51fcee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a3a9ea2-67a5-4caa-8b3f-34b532c216ca', 'volume_name': 'volume-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9268f40c-0d29-4873-a7ea-d247fa6dbd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9268f40c-0d29-4873-a7ea-d247fa6dbd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a1e673-d41a-42c2-a95a-60abe802b0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:31 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Volume 3a3a9ea2-67a5-4caa-8b3f-34b532c216ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca', 'volume_size': 1} Nov 02 10:46:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:32 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d0c186a7-e107-4f60-a43c-50c4f7ae9524 1073741824" returned: 0 in 0.631s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d0c186a7-e107-4f60-a43c-50c4f7ae9524 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:32 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d0c186a7-e107-4f60-a43c-50c4f7ae9524 Nov 02 10:46:32 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:32 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d0c186a7-e107-4f60-a43c-50c4f7ae9524" returned: 0 in 0.333s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.703s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-936258267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3a9ea2-67a5-4caa-8b3f-34b532c216ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e78c44ca78e4fea8f7f42bbc1eaf5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:32Z,use_quota=True,user_id='cc34c259f11044a39b94499398dd89fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Creating volume 3a3a9ea2-67a5-4caa-8b3f-34b532c216ca {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:32 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:46:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb8c145-db31-4df0-b93b-ff56418853ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c186a7-e107-4f60-a43c-50c4f7ae9524', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:32 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca 1073741824 Nov 02 10:46:32 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d0eac7-23ac-4884-8cf7-314f18f515e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:32 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Volume volume-d0c186a7-e107-4f60-a43c-50c4f7ae9524 (d0c186a7-e107-4f60-a43c-50c4f7ae9524): created successfully Nov 02 10:46:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d0eac7-23ac-4884-8cf7-314f18f515e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Flow 'volume_create_manager' (e8948ec5-3538-4a79-b7d5-cf9a964f5c24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:32 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-696e544c-7ec3-4aa5-97f2-f68522cf8275 tempest-VolumesTestJSON-622930993 None] Created volume successfully. Nov 02 10:46:33 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca 1073741824" returned: 0 in 0.611s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:33 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca Nov 02 10:46:33 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:33 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca" returned: 0 in 0.327s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a1e673-d41a-42c2-a95a-60abe802b0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c7471d-3680-4929-8b31-638caab915e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:33 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Volume volume-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca (3a3a9ea2-67a5-4caa-8b3f-34b532c216ca): created successfully Nov 02 10:46:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c7471d-3680-4929-8b31-638caab915e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Flow 'volume_create_manager' (b0b0e516-52ca-4f88-814f-7cd7fa1d8c47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5fe8605e-986b-423b-8ede-f9ee1969757b tempest-ServersNegativeTestJSON-2103012701 None] Created volume successfully. Nov 02 10:46:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bea04c52-c2e5-4bbf-b409-5c503bb34f51 tempest-VolumesTestJSON-622930993 None] Acquiring lock "cinder-d0c186a7-e107-4f60-a43c-50c4f7ae9524-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bea04c52-c2e5-4bbf-b409-5c503bb34f51 tempest-VolumesTestJSON-622930993 None] Lock "cinder-d0c186a7-e107-4f60-a43c-50c4f7ae9524-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bea04c52-c2e5-4bbf-b409-5c503bb34f51 tempest-VolumesTestJSON-622930993 None] Acquiring lock "cinder-quobyte-d0c186a7-e107-4f60-a43c-50c4f7ae9524" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bea04c52-c2e5-4bbf-b409-5c503bb34f51 tempest-VolumesTestJSON-622930993 None] Lock "cinder-quobyte-d0c186a7-e107-4f60-a43c-50c4f7ae9524" acquired by "delete_volume" :: waited 0.037s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:35 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[883b289d-d446-43bf-9872-92c67029e495]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bea04c52-c2e5-4bbf-b409-5c503bb34f51 tempest-VolumesTestJSON-622930993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d0c186a7-e107-4f60-a43c-50c4f7ae9524 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:35 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d0c186a7-e107-4f60-a43c-50c4f7ae9524 Nov 02 10:46:35 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:35 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Flow 'volume_create_manager' (fdbe8605-6979-4d4d-b2ce-7cbd7c5e7c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c622e70-0969-43dd-bc48-6e8d5e888630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c622e70-0969-43dd-bc48-6e8d5e888630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-550562328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d98c2962-5dfc-4250-a62d-e9cf74277676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e78c44ca78e4fea8f7f42bbc1eaf5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:36Z,use_quota=True,user_id='cc34c259f11044a39b94499398dd89fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab522dd-cbcf-4e5d-9397-ddbb8865e4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab522dd-cbcf-4e5d-9397-ddbb8865e4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c2c3cc-36b2-4dc4-acd6-9ff06ac1659c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c2c3cc-36b2-4dc4-acd6-9ff06ac1659c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd98c2962-5dfc-4250-a62d-e9cf74277676', 'volume_name': 'volume-d98c2962-5dfc-4250-a62d-e9cf74277676', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231bb9c2-5fb5-456f-a644-950000736e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231bb9c2-5fb5-456f-a644-950000736e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ade1ed4-5b7f-4baa-8711-78bee431b56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:36 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Volume d98c2962-5dfc-4250-a62d-e9cf74277676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d98c2962-5dfc-4250-a62d-e9cf74277676', 'volume_size': 1} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-550562328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d98c2962-5dfc-4250-a62d-e9cf74277676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e78c44ca78e4fea8f7f42bbc1eaf5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:36Z,use_quota=True,user_id='cc34c259f11044a39b94499398dd89fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Creating volume d98c2962-5dfc-4250-a62d-e9cf74277676 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:36 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d98c2962-5dfc-4250-a62d-e9cf74277676 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:36 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d98c2962-5dfc-4250-a62d-e9cf74277676 1073741824 Nov 02 10:46:36 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:36 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bea04c52-c2e5-4bbf-b409-5c503bb34f51 tempest-VolumesTestJSON-622930993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d0c186a7-e107-4f60-a43c-50c4f7ae9524" returned: 0 in 0.613s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bea04c52-c2e5-4bbf-b409-5c503bb34f51 tempest-VolumesTestJSON-622930993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d0c186a7-e107-4f60-a43c-50c4f7ae9524 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:36 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d0c186a7-e107-4f60-a43c-50c4f7ae9524 Nov 02 10:46:36 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:36 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bea04c52-c2e5-4bbf-b409-5c503bb34f51 tempest-VolumesTestJSON-622930993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d0c186a7-e107-4f60-a43c-50c4f7ae9524" returned: 0 in 0.388s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bea04c52-c2e5-4bbf-b409-5c503bb34f51 tempest-VolumesTestJSON-622930993 None] Lock "cinder-quobyte-d0c186a7-e107-4f60-a43c-50c4f7ae9524" released by "delete_volume" :: held 1.113s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-bea04c52-c2e5-4bbf-b409-5c503bb34f51 tempest-VolumesTestJSON-622930993 None] Created reservations ['34fce4a2-618a-49b2-8ae6-54fe8e3dddc5', '685d61e2-6c5f-4024-8714-2d6cd2cf7acc', '666bb07c-2b34-48b2-8257-4096df5c42e1', 'a88f84cc-d483-4ffd-b6ac-098fcae73a13'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:36 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d98c2962-5dfc-4250-a62d-e9cf74277676 1073741824" returned: 0 in 0.648s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bea04c52-c2e5-4bbf-b409-5c503bb34f51 tempest-VolumesTestJSON-622930993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bea04c52-c2e5-4bbf-b409-5c503bb34f51 tempest-VolumesTestJSON-622930993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-bea04c52-c2e5-4bbf-b409-5c503bb34f51 tempest-VolumesTestJSON-622930993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-bea04c52-c2e5-4bbf-b409-5c503bb34f51 tempest-VolumesTestJSON-622930993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bea04c52-c2e5-4bbf-b409-5c503bb34f51 tempest-VolumesTestJSON-622930993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bea04c52-c2e5-4bbf-b409-5c503bb34f51 tempest-VolumesTestJSON-622930993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:36 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:46:36 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d98c2962-5dfc-4250-a62d-e9cf74277676 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:36 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d98c2962-5dfc-4250-a62d-e9cf74277676 Nov 02 10:46:36 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:37 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bea04c52-c2e5-4bbf-b409-5c503bb34f51 tempest-VolumesTestJSON-622930993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.298s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-bea04c52-c2e5-4bbf-b409-5c503bb34f51 tempest-VolumesTestJSON-622930993 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-bea04c52-c2e5-4bbf-b409-5c503bb34f51 tempest-VolumesTestJSON-622930993 None] Deleted volume successfully. Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bea04c52-c2e5-4bbf-b409-5c503bb34f51 tempest-VolumesTestJSON-622930993 None] Lock "cinder-d0c186a7-e107-4f60-a43c-50c4f7ae9524-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:37 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d98c2962-5dfc-4250-a62d-e9cf74277676" returned: 0 in 0.324s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ade1ed4-5b7f-4baa-8711-78bee431b56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d98c2962-5dfc-4250-a62d-e9cf74277676', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62424cdf-6154-4d49-acf2-dcfd14eec876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:37 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Volume volume-d98c2962-5dfc-4250-a62d-e9cf74277676 (d98c2962-5dfc-4250-a62d-e9cf74277676): created successfully Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62424cdf-6154-4d49-acf2-dcfd14eec876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Flow 'volume_create_manager' (fdbe8605-6979-4d4d-b2ce-7cbd7c5e7c30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8c883930-5b60-45c3-af82-374b5b49ee52 tempest-ServersNegativeTestJSON-2103012701 None] Created volume successfully. Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Flow 'volume_create_manager' (2e595784-e7b8-4242-807e-d5e337d4c995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63d8ccf-1f69-4ffa-b130-fd33b7ac3e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63d8ccf-1f69-4ffa-b130-fd33b7ac3e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-577530833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=819f7f00-c594-43c9-b856-6553943ad766,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e0ef435b4c94e729346b963a40ef057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:37Z,use_quota=True,user_id='3e5f499a875d4866a250710c3ed390f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad01cfb1-5d7b-4997-86a7-a93340629721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad01cfb1-5d7b-4997-86a7-a93340629721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71152a6d-bed9-493d-b4ee-4b77475760f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71152a6d-bed9-493d-b4ee-4b77475760f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '819f7f00-c594-43c9-b856-6553943ad766', 'volume_name': 'volume-819f7f00-c594-43c9-b856-6553943ad766', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08cefabf-fa59-4a5d-a034-e12321895aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08cefabf-fa59-4a5d-a034-e12321895aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f057a0-12aa-47be-b59a-5c8ce5361b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:37 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Volume 819f7f00-c594-43c9-b856-6553943ad766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-819f7f00-c594-43c9-b856-6553943ad766', 'volume_size': 1} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-577530833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=819f7f00-c594-43c9-b856-6553943ad766,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e0ef435b4c94e729346b963a40ef057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:37Z,use_quota=True,user_id='3e5f499a875d4866a250710c3ed390f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Creating volume 819f7f00-c594-43c9-b856-6553943ad766 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:37 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-819f7f00-c594-43c9-b856-6553943ad766 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-20336a29-d5c5-4106-8df4-1003c141ddbe tempest-VolumesTestJSON-622930993 None] Acquiring lock "cinder-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:37 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-819f7f00-c594-43c9-b856-6553943ad766 1073741824 Nov 02 10:46:37 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-20336a29-d5c5-4106-8df4-1003c141ddbe tempest-VolumesTestJSON-622930993 None] Lock "cinder-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-20336a29-d5c5-4106-8df4-1003c141ddbe tempest-VolumesTestJSON-622930993 None] Acquiring lock "cinder-quobyte-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-20336a29-d5c5-4106-8df4-1003c141ddbe tempest-VolumesTestJSON-622930993 None] Lock "cinder-quobyte-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[472c81a0-37fa-4fd5-9025-58966f4f52b1]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20336a29-d5c5-4106-8df4-1003c141ddbe tempest-VolumesTestJSON-622930993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:37 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb Nov 02 10:46:37 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:38 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-819f7f00-c594-43c9-b856-6553943ad766 1073741824" returned: 0 in 0.584s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:38 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20336a29-d5c5-4106-8df4-1003c141ddbe tempest-VolumesTestJSON-622930993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb" returned: 0 in 0.463s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20336a29-d5c5-4106-8df4-1003c141ddbe tempest-VolumesTestJSON-622930993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:38 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb Nov 02 10:46:38 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-819f7f00-c594-43c9-b856-6553943ad766 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:38 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-819f7f00-c594-43c9-b856-6553943ad766 Nov 02 10:46:38 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:38 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-819f7f00-c594-43c9-b856-6553943ad766" returned: 0 in 0.301s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f057a0-12aa-47be-b59a-5c8ce5361b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-819f7f00-c594-43c9-b856-6553943ad766', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac17a5a2-dcd7-4098-90a9-9c2855f2f82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:38 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Volume volume-819f7f00-c594-43c9-b856-6553943ad766 (819f7f00-c594-43c9-b856-6553943ad766): created successfully Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac17a5a2-dcd7-4098-90a9-9c2855f2f82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:38 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Flow 'volume_create_manager' (2e595784-e7b8-4242-807e-d5e337d4c995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20336a29-d5c5-4106-8df4-1003c141ddbe tempest-VolumesTestJSON-622930993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb" returned: 0 in 0.427s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-20336a29-d5c5-4106-8df4-1003c141ddbe tempest-VolumesTestJSON-622930993 None] Lock "cinder-quobyte-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb" released by "delete_volume" :: held 0.958s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:38 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3eb54221-13da-4a1f-9bda-63e553ae4851 tempest-VolumesGetTest-1115319392 None] Created volume successfully. Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3fa74e51-9d88-4bfe-a746-490c5f9d45d8 tempest-ServersNegativeTestJSON-2103012701 None] Acquiring lock "cinder-d98c2962-5dfc-4250-a62d-e9cf74277676-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3fa74e51-9d88-4bfe-a746-490c5f9d45d8 tempest-ServersNegativeTestJSON-2103012701 None] Lock "cinder-d98c2962-5dfc-4250-a62d-e9cf74277676-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-20336a29-d5c5-4106-8df4-1003c141ddbe tempest-VolumesTestJSON-622930993 None] Created reservations ['e13e80b5-aeb1-4f66-bb23-6f336b5e5a3d', '7c50deae-39ef-4cd5-a1ab-af89c30b33bb', 'df3aaeef-32f8-449c-a3d8-97a731c9c5f2', 'd6fe748e-b37c-40ff-a14e-71f43b330043'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3fa74e51-9d88-4bfe-a746-490c5f9d45d8 tempest-ServersNegativeTestJSON-2103012701 None] Acquiring lock "cinder-quobyte-d98c2962-5dfc-4250-a62d-e9cf74277676" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3fa74e51-9d88-4bfe-a746-490c5f9d45d8 tempest-ServersNegativeTestJSON-2103012701 None] Lock "cinder-quobyte-d98c2962-5dfc-4250-a62d-e9cf74277676" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-20336a29-d5c5-4106-8df4-1003c141ddbe tempest-VolumesTestJSON-622930993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-20336a29-d5c5-4106-8df4-1003c141ddbe tempest-VolumesTestJSON-622930993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-20336a29-d5c5-4106-8df4-1003c141ddbe tempest-VolumesTestJSON-622930993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-20336a29-d5c5-4106-8df4-1003c141ddbe tempest-VolumesTestJSON-622930993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-20336a29-d5c5-4106-8df4-1003c141ddbe tempest-VolumesTestJSON-622930993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20336a29-d5c5-4106-8df4-1003c141ddbe tempest-VolumesTestJSON-622930993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8ca7bc-febe-4a38-aea5-53602142fe43]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3fa74e51-9d88-4bfe-a746-490c5f9d45d8 tempest-ServersNegativeTestJSON-2103012701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d98c2962-5dfc-4250-a62d-e9cf74277676 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:38 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:46:38 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:39 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d98c2962-5dfc-4250-a62d-e9cf74277676 Nov 02 10:46:39 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:39 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20336a29-d5c5-4106-8df4-1003c141ddbe tempest-VolumesTestJSON-622930993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.391s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:39 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-20336a29-d5c5-4106-8df4-1003c141ddbe tempest-VolumesTestJSON-622930993 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:39 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-20336a29-d5c5-4106-8df4-1003c141ddbe tempest-VolumesTestJSON-622930993 None] Deleted volume successfully. Nov 02 10:46:39 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-20336a29-d5c5-4106-8df4-1003c141ddbe tempest-VolumesTestJSON-622930993 None] Lock "cinder-91f961f5-017a-4a3d-8aa4-0cd8aeef9ccb-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3fa74e51-9d88-4bfe-a746-490c5f9d45d8 tempest-ServersNegativeTestJSON-2103012701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d98c2962-5dfc-4250-a62d-e9cf74277676" returned: 0 in 0.450s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3fa74e51-9d88-4bfe-a746-490c5f9d45d8 tempest-ServersNegativeTestJSON-2103012701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d98c2962-5dfc-4250-a62d-e9cf74277676 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:39 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d98c2962-5dfc-4250-a62d-e9cf74277676 Nov 02 10:46:39 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:39 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3fa74e51-9d88-4bfe-a746-490c5f9d45d8 tempest-ServersNegativeTestJSON-2103012701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d98c2962-5dfc-4250-a62d-e9cf74277676" returned: 0 in 0.249s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3fa74e51-9d88-4bfe-a746-490c5f9d45d8 tempest-ServersNegativeTestJSON-2103012701 None] Lock "cinder-quobyte-d98c2962-5dfc-4250-a62d-e9cf74277676" released by "delete_volume" :: held 0.794s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:39 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-3fa74e51-9d88-4bfe-a746-490c5f9d45d8 tempest-ServersNegativeTestJSON-2103012701 None] Created reservations ['bd0d98ac-8c50-4134-a755-789b612812aa', 'b524fa27-3775-457f-b0b6-29ad582ec7be', '2f29873f-2e78-439e-8242-1936f3135158', 'f41a155d-47ae-4276-9b25-9453d0a7acb9'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3fa74e51-9d88-4bfe-a746-490c5f9d45d8 tempest-ServersNegativeTestJSON-2103012701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3fa74e51-9d88-4bfe-a746-490c5f9d45d8 tempest-ServersNegativeTestJSON-2103012701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3fa74e51-9d88-4bfe-a746-490c5f9d45d8 tempest-ServersNegativeTestJSON-2103012701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3fa74e51-9d88-4bfe-a746-490c5f9d45d8 tempest-ServersNegativeTestJSON-2103012701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3fa74e51-9d88-4bfe-a746-490c5f9d45d8 tempest-ServersNegativeTestJSON-2103012701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3fa74e51-9d88-4bfe-a746-490c5f9d45d8 tempest-ServersNegativeTestJSON-2103012701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:39 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:46:39 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d611071c-6bb8-4f8d-8e43-3b8d660d644d tempest-VolumesTestJSON-622930993 None] Acquiring lock "cinder-751c6b59-acb9-4c54-ba21-2b3520de1e90-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d611071c-6bb8-4f8d-8e43-3b8d660d644d tempest-VolumesTestJSON-622930993 None] Lock "cinder-751c6b59-acb9-4c54-ba21-2b3520de1e90-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d611071c-6bb8-4f8d-8e43-3b8d660d644d tempest-VolumesTestJSON-622930993 None] Acquiring lock "cinder-quobyte-751c6b59-acb9-4c54-ba21-2b3520de1e90" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-db776f6b-0d22-49d9-bb6c-6ee92c20025a tempest-ServersNegativeTestJSON-2103012701 None] Acquiring lock "cinder-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d611071c-6bb8-4f8d-8e43-3b8d660d644d tempest-VolumesTestJSON-622930993 None] Lock "cinder-quobyte-751c6b59-acb9-4c54-ba21-2b3520de1e90" acquired by "delete_volume" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-db776f6b-0d22-49d9-bb6c-6ee92c20025a tempest-ServersNegativeTestJSON-2103012701 None] Lock "cinder-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:40 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4751f1db-cb17-4a68-948d-3bce0001d273]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d611071c-6bb8-4f8d-8e43-3b8d660d644d tempest-VolumesTestJSON-622930993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-751c6b59-acb9-4c54-ba21-2b3520de1e90 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:40 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3fa74e51-9d88-4bfe-a746-490c5f9d45d8 tempest-ServersNegativeTestJSON-2103012701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.387s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:40 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-3fa74e51-9d88-4bfe-a746-490c5f9d45d8 tempest-ServersNegativeTestJSON-2103012701 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-db776f6b-0d22-49d9-bb6c-6ee92c20025a tempest-ServersNegativeTestJSON-2103012701 None] Acquiring lock "cinder-quobyte-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:40 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3fa74e51-9d88-4bfe-a746-490c5f9d45d8 tempest-ServersNegativeTestJSON-2103012701 None] Deleted volume successfully. Nov 02 10:46:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-db776f6b-0d22-49d9-bb6c-6ee92c20025a tempest-ServersNegativeTestJSON-2103012701 None] Lock "cinder-quobyte-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca" acquired by "delete_volume" :: waited 0.036s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3fa74e51-9d88-4bfe-a746-490c5f9d45d8 tempest-ServersNegativeTestJSON-2103012701 None] Lock "cinder-d98c2962-5dfc-4250-a62d-e9cf74277676-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:40 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[05201a87-67d8-453e-a74d-4283d288d79b]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db776f6b-0d22-49d9-bb6c-6ee92c20025a tempest-ServersNegativeTestJSON-2103012701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:40 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-751c6b59-acb9-4c54-ba21-2b3520de1e90 Nov 02 10:46:40 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:40 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca Nov 02 10:46:40 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:40 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d611071c-6bb8-4f8d-8e43-3b8d660d644d tempest-VolumesTestJSON-622930993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-751c6b59-acb9-4c54-ba21-2b3520de1e90" returned: 0 in 0.523s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d611071c-6bb8-4f8d-8e43-3b8d660d644d tempest-VolumesTestJSON-622930993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-751c6b59-acb9-4c54-ba21-2b3520de1e90 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:40 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-751c6b59-acb9-4c54-ba21-2b3520de1e90 Nov 02 10:46:40 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:40 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db776f6b-0d22-49d9-bb6c-6ee92c20025a tempest-ServersNegativeTestJSON-2103012701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca" returned: 0 in 0.517s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db776f6b-0d22-49d9-bb6c-6ee92c20025a tempest-ServersNegativeTestJSON-2103012701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:40 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca Nov 02 10:46:40 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:41 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d611071c-6bb8-4f8d-8e43-3b8d660d644d tempest-VolumesTestJSON-622930993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-751c6b59-acb9-4c54-ba21-2b3520de1e90" returned: 0 in 0.363s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Flow 'volume_create_manager' (cb41c050-a69d-43df-b76a-2d1b4eded929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dadb89fc-c810-43d0-acc4-3a1818ee5c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d611071c-6bb8-4f8d-8e43-3b8d660d644d tempest-VolumesTestJSON-622930993 None] Lock "cinder-quobyte-751c6b59-acb9-4c54-ba21-2b3520de1e90" released by "delete_volume" :: held 1.008s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dadb89fc-c810-43d0-acc4-3a1818ee5c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1731345351',display_name='tempest-VolumesGetTest-Volume-322456330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ab2d80-693f-4062-871c-d6e9d15be9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0ef435b4c94e729346b963a40ef057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:41Z,use_quota=True,user_id='3e5f499a875d4866a250710c3ed390f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58867bdb-77d0-4e8b-9988-d3bac7d2e332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58867bdb-77d0-4e8b-9988-d3bac7d2e332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea20da20-f751-4bb2-b3f3-f180443a6f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea20da20-f751-4bb2-b3f3-f180443a6f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5ab2d80-693f-4062-871c-d6e9d15be9a9', 'volume_name': 'volume-b5ab2d80-693f-4062-871c-d6e9d15be9a9', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e11d919-590b-47ca-9556-f7c357391d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e11d919-590b-47ca-9556-f7c357391d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:41 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6299086f-5c75-406d-bf9c-f4a99b4c0de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Volume b5ab2d80-693f-4062-871c-d6e9d15be9a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5ab2d80-693f-4062-871c-d6e9d15be9a9', 'volume_size': 1} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1731345351',display_name='tempest-VolumesGetTest-Volume-322456330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ab2d80-693f-4062-871c-d6e9d15be9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0ef435b4c94e729346b963a40ef057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:41Z,use_quota=True,user_id='3e5f499a875d4866a250710c3ed390f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Creating volume b5ab2d80-693f-4062-871c-d6e9d15be9a9 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:41 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b5ab2d80-693f-4062-871c-d6e9d15be9a9 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db776f6b-0d22-49d9-bb6c-6ee92c20025a tempest-ServersNegativeTestJSON-2103012701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca" returned: 0 in 0.382s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:41 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b5ab2d80-693f-4062-871c-d6e9d15be9a9 1073741824 Nov 02 10:46:41 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-db776f6b-0d22-49d9-bb6c-6ee92c20025a tempest-ServersNegativeTestJSON-2103012701 None] Lock "cinder-quobyte-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca" released by "delete_volume" :: held 0.966s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-db776f6b-0d22-49d9-bb6c-6ee92c20025a tempest-ServersNegativeTestJSON-2103012701 None] Created reservations ['ee3766b2-33d9-43f9-87e0-df876df7fb48', 'd4cb47a4-eb35-4200-ab9f-56a2a1df5f77', 'a677d866-b758-4317-8161-29ce68d726c3', 'a56e1dd2-9947-452c-b3d6-d23e446d48f1'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-d611071c-6bb8-4f8d-8e43-3b8d660d644d tempest-VolumesTestJSON-622930993 None] Created reservations ['dd7b0327-ab8f-4502-a174-6dc28f6669c7', '2a599c58-8802-43c7-bcc3-e6a26b35eb69', '2f23ad57-96a4-4b73-a7e6-ad0b7154e627', '66cc7cdf-d48c-447f-a055-ba991af25d1a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d611071c-6bb8-4f8d-8e43-3b8d660d644d tempest-VolumesTestJSON-622930993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d611071c-6bb8-4f8d-8e43-3b8d660d644d tempest-VolumesTestJSON-622930993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d611071c-6bb8-4f8d-8e43-3b8d660d644d tempest-VolumesTestJSON-622930993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d611071c-6bb8-4f8d-8e43-3b8d660d644d tempest-VolumesTestJSON-622930993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d611071c-6bb8-4f8d-8e43-3b8d660d644d tempest-VolumesTestJSON-622930993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d611071c-6bb8-4f8d-8e43-3b8d660d644d tempest-VolumesTestJSON-622930993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:41 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:46:41 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-db776f6b-0d22-49d9-bb6c-6ee92c20025a tempest-ServersNegativeTestJSON-2103012701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-db776f6b-0d22-49d9-bb6c-6ee92c20025a tempest-ServersNegativeTestJSON-2103012701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-db776f6b-0d22-49d9-bb6c-6ee92c20025a tempest-ServersNegativeTestJSON-2103012701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-db776f6b-0d22-49d9-bb6c-6ee92c20025a tempest-ServersNegativeTestJSON-2103012701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-db776f6b-0d22-49d9-bb6c-6ee92c20025a tempest-ServersNegativeTestJSON-2103012701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db776f6b-0d22-49d9-bb6c-6ee92c20025a tempest-ServersNegativeTestJSON-2103012701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:41 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:46:41 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:41 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b5ab2d80-693f-4062-871c-d6e9d15be9a9 1073741824" returned: 0 in 0.555s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b5ab2d80-693f-4062-871c-d6e9d15be9a9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:41 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d611071c-6bb8-4f8d-8e43-3b8d660d644d tempest-VolumesTestJSON-622930993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.341s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-d611071c-6bb8-4f8d-8e43-3b8d660d644d tempest-VolumesTestJSON-622930993 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:41 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b5ab2d80-693f-4062-871c-d6e9d15be9a9 Nov 02 10:46:41 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d611071c-6bb8-4f8d-8e43-3b8d660d644d tempest-VolumesTestJSON-622930993 None] Deleted volume successfully. Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d611071c-6bb8-4f8d-8e43-3b8d660d644d tempest-VolumesTestJSON-622930993 None] Lock "cinder-751c6b59-acb9-4c54-ba21-2b3520de1e90-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:41 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db776f6b-0d22-49d9-bb6c-6ee92c20025a tempest-ServersNegativeTestJSON-2103012701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.304s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-db776f6b-0d22-49d9-bb6c-6ee92c20025a tempest-ServersNegativeTestJSON-2103012701 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-db776f6b-0d22-49d9-bb6c-6ee92c20025a tempest-ServersNegativeTestJSON-2103012701 None] Deleted volume successfully. Nov 02 10:46:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-db776f6b-0d22-49d9-bb6c-6ee92c20025a tempest-ServersNegativeTestJSON-2103012701 None] Lock "cinder-3a3a9ea2-67a5-4caa-8b3f-34b532c216ca-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:42 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b5ab2d80-693f-4062-871c-d6e9d15be9a9" returned: 0 in 0.287s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6299086f-5c75-406d-bf9c-f4a99b4c0de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5ab2d80-693f-4062-871c-d6e9d15be9a9', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16129635-e74e-4a2e-b296-68c5e345a2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:42 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Volume volume-b5ab2d80-693f-4062-871c-d6e9d15be9a9 (b5ab2d80-693f-4062-871c-d6e9d15be9a9): created successfully Nov 02 10:46:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16129635-e74e-4a2e-b296-68c5e345a2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Flow 'volume_create_manager' (cb41c050-a69d-43df-b76a-2d1b4eded929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:42 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-72b42fb7-44a3-4d48-b42d-ea56287be6a5 tempest-VolumesGetTest-1115319392 None] Created volume successfully. Nov 02 10:46:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dca244a1-5a8d-4e2a-86a9-9e4cc58b3316 tempest-VolumesGetTest-1115319392 None] Acquiring lock "cinder-b5ab2d80-693f-4062-871c-d6e9d15be9a9-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dca244a1-5a8d-4e2a-86a9-9e4cc58b3316 tempest-VolumesGetTest-1115319392 None] Lock "cinder-b5ab2d80-693f-4062-871c-d6e9d15be9a9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dca244a1-5a8d-4e2a-86a9-9e4cc58b3316 tempest-VolumesGetTest-1115319392 None] Acquiring lock "cinder-quobyte-b5ab2d80-693f-4062-871c-d6e9d15be9a9" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dca244a1-5a8d-4e2a-86a9-9e4cc58b3316 tempest-VolumesGetTest-1115319392 None] Lock "cinder-quobyte-b5ab2d80-693f-4062-871c-d6e9d15be9a9" acquired by "delete_volume" :: waited 0.036s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:43 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7327ed26-62f0-41e3-8310-e014caa0ac9f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dca244a1-5a8d-4e2a-86a9-9e4cc58b3316 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b5ab2d80-693f-4062-871c-d6e9d15be9a9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:43 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b5ab2d80-693f-4062-871c-d6e9d15be9a9 Nov 02 10:46:43 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:43 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Flow 'volume_create_manager' (4cd414e7-9de6-4ad4-95f2-61a73c3ac403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca58eca-e09f-464f-b650-f72adc8d6039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca58eca-e09f-464f-b650-f72adc8d6039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1324011633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c470c552-0987-46ef-8be5-0c7b82461c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7938eea442d40c8ba96d0e1e6a7f0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:44Z,use_quota=True,user_id='c1b57603d41c4ffb97c62e3a773eb178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d472701-d707-47c9-8491-fe0439deb538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d472701-d707-47c9-8491-fe0439deb538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5bb980a-de64-4706-a7bb-378d5e66f85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:43 devstack cinder-volume[87084]: DEBUG cinder.image.glance [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Creating Keystone auth plugin from conf {{(pid=87084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:46:44 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dca244a1-5a8d-4e2a-86a9-9e4cc58b3316 tempest-VolumesGetTest-1115319392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b5ab2d80-693f-4062-871c-d6e9d15be9a9" returned: 0 in 0.491s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dca244a1-5a8d-4e2a-86a9-9e4cc58b3316 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b5ab2d80-693f-4062-871c-d6e9d15be9a9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:44 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b5ab2d80-693f-4062-871c-d6e9d15be9a9 Nov 02 10:46:44 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5bb980a-de64-4706-a7bb-378d5e66f85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c470c552-0987-46ef-8be5-0c7b82461c28', 'volume_name': 'volume-c470c552-0987-46ef-8be5-0c7b82461c28', 'volume_size': 1, 'image_id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9af457eb3c6844a99ee880354ae43eac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'created_at': datetime.datetime(2026, 11, 2, 9, 33, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0223-61d3-44de-a27f-c6e0b6ba1310/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ddfe199-fb8d-4269-9c26-d9e3079d4ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ddfe199-fb8d-4269-9c26-d9e3079d4ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf651df-6af3-49ca-b321-1fa3bbddb4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:44 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Volume c470c552-0987-46ef-8be5-0c7b82461c28: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c470c552-0987-46ef-8be5-0c7b82461c28', 'volume_size': 1, 'image_id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9af457eb3c6844a99ee880354ae43eac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'created_at': datetime.datetime(2026, 11, 2, 9, 33, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0223-61d3-44de-a27f-c6e0b6ba1310/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:46:44 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Trying to clone c470c552-0987-46ef-8be5-0c7b82461c28 from image 918d0223-61d3-44de-a27f-c6e0b6ba1310 at location (None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}]). {{(pid=87084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:46:44 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dca244a1-5a8d-4e2a-86a9-9e4cc58b3316 tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b5ab2d80-693f-4062-871c-d6e9d15be9a9" returned: 0 in 0.463s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dca244a1-5a8d-4e2a-86a9-9e4cc58b3316 tempest-VolumesGetTest-1115319392 None] Lock "cinder-quobyte-b5ab2d80-693f-4062-871c-d6e9d15be9a9" released by "delete_volume" :: held 1.032s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:44 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-dca244a1-5a8d-4e2a-86a9-9e4cc58b3316 tempest-VolumesGetTest-1115319392 None] Created reservations ['e8a81fd8-1894-473a-aeb2-ea090901a26a', 'a636a39f-2e8a-4507-bd3e-706c79d1934c', 'ac15eaeb-0423-413a-b43d-81f2179b6a1e', '2e1f09b1-ab2c-4850-bbf8-c1c2007e077f'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dca244a1-5a8d-4e2a-86a9-9e4cc58b3316 tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dca244a1-5a8d-4e2a-86a9-9e4cc58b3316 tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-dca244a1-5a8d-4e2a-86a9-9e4cc58b3316 tempest-VolumesGetTest-1115319392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-dca244a1-5a8d-4e2a-86a9-9e4cc58b3316 tempest-VolumesGetTest-1115319392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dca244a1-5a8d-4e2a-86a9-9e4cc58b3316 tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dca244a1-5a8d-4e2a-86a9-9e4cc58b3316 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:44 devstack sudo[96017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:46:44 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:45 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_w1rl2ktndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:46:45 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:46:45 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b050841-8e1f-4d51-9b66-4753fa9abd88]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_w1rl2ktndevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:45 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dca244a1-5a8d-4e2a-86a9-9e4cc58b3316 tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.341s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:45 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-dca244a1-5a8d-4e2a-86a9-9e4cc58b3316 tempest-VolumesGetTest-1115319392 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-dca244a1-5a8d-4e2a-86a9-9e4cc58b3316 tempest-VolumesGetTest-1115319392 None] Deleted volume successfully. Nov 02 10:46:45 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_w1rl2ktndevstack@QuobyteHD Nov 02 10:46:45 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dca244a1-5a8d-4e2a-86a9-9e4cc58b3316 tempest-VolumesGetTest-1115319392 None] Lock "cinder-b5ab2d80-693f-4062-871c-d6e9d15be9a9-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:45 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_w1rl2ktndevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:45 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Temporary image 918d0223-61d3-44de-a27f-c6e0b6ba1310 is fetched for user c1b57603d41c4ffb97c62e3a773eb178. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:46:45 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a256379f-428b-4460-a686-3eb4b8f94af7]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_w1rl2ktndevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:45 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_w1rl2ktndevstack@QuobyteHD Nov 02 10:46:45 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dc9cfb0f-151c-4b4c-bbf2-cb8768c51ecf tempest-VolumesGetTest-1115319392 None] Acquiring lock "cinder-819f7f00-c594-43c9-b856-6553943ad766-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dc9cfb0f-151c-4b4c-bbf2-cb8768c51ecf tempest-VolumesGetTest-1115319392 None] Lock "cinder-819f7f00-c594-43c9-b856-6553943ad766-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dc9cfb0f-151c-4b4c-bbf2-cb8768c51ecf tempest-VolumesGetTest-1115319392 None] Acquiring lock "cinder-quobyte-819f7f00-c594-43c9-b856-6553943ad766" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dc9cfb0f-151c-4b4c-bbf2-cb8768c51ecf tempest-VolumesGetTest-1115319392 None] Lock "cinder-quobyte-819f7f00-c594-43c9-b856-6553943ad766" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e4962c-d8b3-4a33-9ac0-5a5c00611146]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dc9cfb0f-151c-4b4c-bbf2-cb8768c51ecf tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-819f7f00-c594-43c9-b856-6553943ad766 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:46 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_w1rl2ktndevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1324011633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c470c552-0987-46ef-8be5-0c7b82461c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7938eea442d40c8ba96d0e1e6a7f0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:44Z,use_quota=True,user_id='c1b57603d41c4ffb97c62e3a773eb178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Creating volume c470c552-0987-46ef-8be5-0c7b82461c28 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:46 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c470c552-0987-46ef-8be5-0c7b82461c28 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:46 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c470c552-0987-46ef-8be5-0c7b82461c28 1073741824 Nov 02 10:46:46 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:46 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-819f7f00-c594-43c9-b856-6553943ad766 Nov 02 10:46:46 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:46 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dc9cfb0f-151c-4b4c-bbf2-cb8768c51ecf tempest-VolumesGetTest-1115319392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-819f7f00-c594-43c9-b856-6553943ad766" returned: 0 in 0.451s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dc9cfb0f-151c-4b4c-bbf2-cb8768c51ecf tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-819f7f00-c594-43c9-b856-6553943ad766 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:46 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-819f7f00-c594-43c9-b856-6553943ad766 Nov 02 10:46:46 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:46 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c470c552-0987-46ef-8be5-0c7b82461c28 1073741824" returned: 0 in 0.608s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c470c552-0987-46ef-8be5-0c7b82461c28 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:46 devstack sudo[96045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c470c552-0987-46ef-8be5-0c7b82461c28 Nov 02 10:46:46 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:46 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dc9cfb0f-151c-4b4c-bbf2-cb8768c51ecf tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-819f7f00-c594-43c9-b856-6553943ad766" returned: 0 in 0.391s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dc9cfb0f-151c-4b4c-bbf2-cb8768c51ecf tempest-VolumesGetTest-1115319392 None] Lock "cinder-quobyte-819f7f00-c594-43c9-b856-6553943ad766" released by "delete_volume" :: held 0.913s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-dc9cfb0f-151c-4b4c-bbf2-cb8768c51ecf tempest-VolumesGetTest-1115319392 None] Created reservations ['82dcdb17-bd6c-43bd-8fd1-740778f002fb', '46cb2aa5-d357-4799-a4ea-bbd37bebfb5a', 'b2a5a946-ef40-454c-9bf7-f316e8fbd06c', '100e3240-8a19-477c-a387-d699e96699e7'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dc9cfb0f-151c-4b4c-bbf2-cb8768c51ecf tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dc9cfb0f-151c-4b4c-bbf2-cb8768c51ecf tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-dc9cfb0f-151c-4b4c-bbf2-cb8768c51ecf tempest-VolumesGetTest-1115319392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-dc9cfb0f-151c-4b4c-bbf2-cb8768c51ecf tempest-VolumesGetTest-1115319392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dc9cfb0f-151c-4b4c-bbf2-cb8768c51ecf tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dc9cfb0f-151c-4b4c-bbf2-cb8768c51ecf tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:47 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:47 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c470c552-0987-46ef-8be5-0c7b82461c28" returned: 0 in 0.371s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:47 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Attempting download of 918d0223-61d3-44de-a27f-c6e0b6ba1310 ((None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}])) to volume c470c552-0987-46ef-8be5-0c7b82461c28. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e60e2b-bbbc-44ac-9432-d578487de708]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_w46kfk0y {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:47 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_w46kfk0y Nov 02 10:46:47 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:47 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dc9cfb0f-151c-4b4c-bbf2-cb8768c51ecf tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.531s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-dc9cfb0f-151c-4b4c-bbf2-cb8768c51ecf tempest-VolumesGetTest-1115319392 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-dc9cfb0f-151c-4b4c-bbf2-cb8768c51ecf tempest-VolumesGetTest-1115319392 None] Deleted volume successfully. Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dc9cfb0f-151c-4b4c-bbf2-cb8768c51ecf tempest-VolumesGetTest-1115319392 None] Lock "cinder-819f7f00-c594-43c9-b856-6553943ad766-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:47 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_w46kfk0y" returned: 0 in 0.471s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_w46kfk0y {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:47 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_w46kfk0y Nov 02 10:46:47 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Flow 'volume_create_manager' (0ed86119-f3cd-410c-a4aa-0ab90d1a7aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39dedfe3-4235-4530-9fd1-2038cffd7a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39dedfe3-4235-4530-9fd1-2038cffd7a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-328747850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9cf2042-4017-4eaa-b267-39c6d48bcd61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0ef435b4c94e729346b963a40ef057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:48Z,use_quota=True,user_id='3e5f499a875d4866a250710c3ed390f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd914032-8a17-4414-b3cf-0c49d9480576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd914032-8a17-4414-b3cf-0c49d9480576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20db79cc-d91c-4781-b79a-c294f386f64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20db79cc-d91c-4781-b79a-c294f386f64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9cf2042-4017-4eaa-b267-39c6d48bcd61', 'volume_name': 'volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6e3526-11d4-4ffd-8a43-3f51ff3b0609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6e3526-11d4-4ffd-8a43-3f51ff3b0609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a84a12-54b0-43e5-a2ee-fc8303179f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:48 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Volume b9cf2042-4017-4eaa-b267-39c6d48bcd61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61', 'volume_size': 1} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-328747850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9cf2042-4017-4eaa-b267-39c6d48bcd61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0ef435b4c94e729346b963a40ef057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:48Z,use_quota=True,user_id='3e5f499a875d4866a250710c3ed390f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Creating volume b9cf2042-4017-4eaa-b267-39c6d48bcd61 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:48 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:48 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 1073741824 Nov 02 10:46:48 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:48 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_w46kfk0y" returned: 1 in 0.495s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_w46kfk0y' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b272e8d-afc8-4ad7-b8fa-92e742fff51f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_w1rl2ktndevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:48 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_w1rl2ktndevstack@QuobyteHD Nov 02 10:46:48 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:48 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:48 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 1073741824" returned: 0 in 0.649s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_w1rl2ktndevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] 918d0223-61d3-44de-a27f-c6e0b6ba1310 was qcow2, converting to qcow2 {{(pid=87084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_w1rl2ktndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c470c552-0987-46ef-8be5-0c7b82461c28 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:48 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_w1rl2ktndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c470c552-0987-46ef-8be5-0c7b82461c28 Nov 02 10:46:48 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:48 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 Nov 02 10:46:48 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:49 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61" returned: 0 in 0.305s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:46:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a84a12-54b0-43e5-a2ee-fc8303179f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6066faf-6a66-46dc-b34e-99d43bf906a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:49 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Volume volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 (b9cf2042-4017-4eaa-b267-39c6d48bcd61): created successfully Nov 02 10:46:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6066faf-6a66-46dc-b34e-99d43bf906a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Flow 'volume_create_manager' (0ed86119-f3cd-410c-a4aa-0ab90d1a7aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b408ae61-de31-4ea0-9a80-bc16cff9538a tempest-VolumesGetTest-1115319392 None] Created volume successfully. Nov 02 10:46:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-551ed455-f3a7-44ce-8610-d4db5a3e8adb tempest-GroupSnapshotsV319Test-1447030872 None] Group tempest-GroupSnapshotsV319Test-Group-815057585: creating Nov 02 10:46:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-551ed455-f3a7-44ce-8610-d4db5a3e8adb tempest-GroupSnapshotsV319Test-1447030872 None] Group tempest-GroupSnapshotsV319Test-Group-815057585: created successfully Nov 02 10:46:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-551ed455-f3a7-44ce-8610-d4db5a3e8adb tempest-GroupSnapshotsV319Test-1447030872 None] Create group completed successfully. Nov 02 10:46:50 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Flow 'volume_create_manager' (795be777-5615-42d6-85e2-dd63bad79f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956516de-f04e-47be-ab3c-ddc4e1986320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956516de-f04e-47be-ab3c-ddc4e1986320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-84057578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e359ef98-bb0b-4114-9e17-e09ea3060e88,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e0ef435b4c94e729346b963a40ef057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b9cf2042-4017-4eaa-b267-39c6d48bcd61,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:51Z,use_quota=True,user_id='3e5f499a875d4866a250710c3ed390f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4071985e-d800-479f-b8ad-f1c4bd097d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4071985e-d800-479f-b8ad-f1c4bd097d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806fbd30-a619-4f52-bec0-bfa790452352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806fbd30-a619-4f52-bec0-bfa790452352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e359ef98-bb0b-4114-9e17-e09ea3060e88', 'volume_name': 'volume-e359ef98-bb0b-4114-9e17-e09ea3060e88', 'volume_size': 1, 'source_volid': 'b9cf2042-4017-4eaa-b267-39c6d48bcd61', 'source_volstatus': 'available'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b145f9d-8b89-469f-929c-0b4dc6481894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b145f9d-8b89-469f-929c-0b4dc6481894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7ec707-f0c3-42a9-b076-dac0c5ea4b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:50 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Volume e359ef98-bb0b-4114-9e17-e09ea3060e88: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e359ef98-bb0b-4114-9e17-e09ea3060e88', 'volume_size': 1, 'source_volid': 'b9cf2042-4017-4eaa-b267-39c6d48bcd61', 'source_volstatus': 'available'} Nov 02 10:46:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:50 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Cloning volume b9cf2042-4017-4eaa-b267-39c6d48bcd61 to volume e359ef98-bb0b-4114-9e17-e09ea3060e88 Nov 02 10:46:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Creating offline snapshot 7974c905-d16f-4fca-9a26-1773d2ed6a26 of volume b9cf2042-4017-4eaa-b267-39c6d48bcd61 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:46:50 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5900df8b-27b7-4518-96e6-d9d2397c8688]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:51 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 Nov 02 10:46:51 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Flow 'volume_create_manager' (397c4baf-33fe-4c6a-b404-3ec4176fe020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25887959-7b8c-4e33-aee3-3c9622122446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:51 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25887959-7b8c-4e33-aee3-3c9622122446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1467159775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0deb067c-52c6-4499-984c-707c51f0fa43,host='devstack@QuobyteHD#QuobyteHD',id=a4b6b717-cee1-46f2-8cdd-f4013c74f422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c3bd4b89d54638a246d445245dae9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:51Z,use_quota=True,user_id='5925a013525b458ab25c2b1f66be849f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc5eba55-4732-4c5f-aa56-e9271d23fac2),volume_type_id=fc5eba55-4732-4c5f-aa56-e9271d23fac2)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22edaf4d-fea0-423f-ba2f-3195367d4956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22edaf4d-fea0-423f-ba2f-3195367d4956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0818b699-8a27-45c8-ad32-614806a35b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0818b699-8a27-45c8-ad32-614806a35b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4b6b717-cee1-46f2-8cdd-f4013c74f422', 'volume_name': 'volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ae2bd9-b811-46eb-bf60-9d3ddd595ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ae2bd9-b811-46eb-bf60-9d3ddd595ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:51 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f65bba-6ec0-43ed-a22f-64378a836d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:51 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Volume a4b6b717-cee1-46f2-8cdd-f4013c74f422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422', 'volume_size': 1} Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_w1rl2ktndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c470c552-0987-46ef-8be5-0c7b82461c28" returned: 0 in 2.811s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_w1rl2ktndevstack@QuobyteHD, size 112.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c470c552-0987-46ef-8be5-0c7b82461c28 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:46:51 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Converted 112.00 MB image at 39.80 MB/s Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c470c552-0987-46ef-8be5-0c7b82461c28 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61" returned: 0 in 0.571s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:51 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c470c552-0987-46ef-8be5-0c7b82461c28 1G Nov 02 10:46:51 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:51 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26 1G Nov 02 10:46:51 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:51 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c470c552-0987-46ef-8be5-0c7b82461c28 1G" returned: 0 in 0.392s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Downloaded image 918d0223-61d3-44de-a27f-c6e0b6ba1310 ((None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}])) to volume c470c552-0987-46ef-8be5-0c7b82461c28 successfully. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Temporary image 918d0223-61d3-44de-a27f-c6e0b6ba1310 for user c1b57603d41c4ffb97c62e3a773eb178 is deleted. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Marking volume c470c552-0987-46ef-8be5-0c7b82461c28 as bootable. {{(pid=87084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Copying metadata from image 918d0223-61d3-44de-a27f-c6e0b6ba1310 to c470c552-0987-46ef-8be5-0c7b82461c28. {{(pid=87084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:46:51 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Creating volume glance metadata for volume c470c552-0987-46ef-8be5-0c7b82461c28 backed by image 918d0223-61d3-44de-a27f-c6e0b6ba1310 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:46:52 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf651df-6af3-49ca-b321-1fa3bbddb4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c470c552-0987-46ef-8be5-0c7b82461c28', 'volume_size': 1, 'image_id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9af457eb3c6844a99ee880354ae43eac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'created_at': datetime.datetime(2026, 11, 2, 9, 33, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0223-61d3-44de-a27f-c6e0b6ba1310/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5cf46b1-befb-4359-b780-f3f384984f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26 1G" returned: 0 in 0.497s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:52 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Volume volume-c470c552-0987-46ef-8be5-0c7b82461c28 (c470c552-0987-46ef-8be5-0c7b82461c28): created successfully Nov 02 10:46:52 devstack sudo[96105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26 Nov 02 10:46:52 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5cf46b1-befb-4359-b780-f3f384984f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Flow 'volume_create_manager' (4cd414e7-9de6-4ad4-95f2-61a73c3ac403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:52 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-36e177ea-0a0b-4d70-9de7-eee10086cbbf tempest-VolumesImageMetadata-337877688 None] Created volume successfully. Nov 02 10:46:52 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26" returned: 0 in 0.327s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:52 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26 is being set with open permissions: ugo+rw Nov 02 10:46:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:52 devstack sudo[96116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26 Nov 02 10:46:52 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:52 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26" returned: 0 in 0.348s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:52 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.info Nov 02 10:46:52 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:46:53 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.info" returned: 0 in 0.296s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:53 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.info is being set with open permissions: ugo+rw Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:53 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.info Nov 02 10:46:53 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2779a7d3-c4c4-4a30-a463-1140efaa4c7f tempest-VolumesImageMetadata-337877688 None] Acquiring lock "cinder-c470c552-0987-46ef-8be5-0c7b82461c28-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2779a7d3-c4c4-4a30-a463-1140efaa4c7f tempest-VolumesImageMetadata-337877688 None] Lock "cinder-c470c552-0987-46ef-8be5-0c7b82461c28-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:53 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.info" returned: 0 in 0.303s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Acquiring lock "cinder-quobyte-e359ef98-bb0b-4114-9e17-e09ea3060e88" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Lock "cinder-quobyte-e359ef98-bb0b-4114-9e17-e09ea3060e88" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] snapshot: 7974c905-d16f-4fca-9a26-1773d2ed6a26, volume: e359ef98-bb0b-4114-9e17-e09ea3060e88, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2779a7d3-c4c4-4a30-a463-1140efaa4c7f tempest-VolumesImageMetadata-337877688 None] Acquiring lock "cinder-quobyte-c470c552-0987-46ef-8be5-0c7b82461c28" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f288678-5c6b-40eb-baea-b3c39c6b0194]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2779a7d3-c4c4-4a30-a463-1140efaa4c7f tempest-VolumesImageMetadata-337877688 None] Lock "cinder-quobyte-c470c552-0987-46ef-8be5-0c7b82461c28" acquired by "delete_volume" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e0e6b9-47bd-46a8-a3b8-b93966d60de4]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2779a7d3-c4c4-4a30-a463-1140efaa4c7f tempest-VolumesImageMetadata-337877688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c470c552-0987-46ef-8be5-0c7b82461c28 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:53 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26 Nov 02 10:46:53 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:53 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c470c552-0987-46ef-8be5-0c7b82461c28 Nov 02 10:46:53 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:53 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:53 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26" returned: 0 in 0.455s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2779a7d3-c4c4-4a30-a463-1140efaa4c7f tempest-VolumesImageMetadata-337877688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c470c552-0987-46ef-8be5-0c7b82461c28" returned: 0 in 0.413s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2779a7d3-c4c4-4a30-a463-1140efaa4c7f tempest-VolumesImageMetadata-337877688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c470c552-0987-46ef-8be5-0c7b82461c28 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b30d0b3-a290-4523-8ded-b7981ecfd833]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:53 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c470c552-0987-46ef-8be5-0c7b82461c28 Nov 02 10:46:53 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:54 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 Nov 02 10:46:54 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:54 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2779a7d3-c4c4-4a30-a463-1140efaa4c7f tempest-VolumesImageMetadata-337877688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c470c552-0987-46ef-8be5-0c7b82461c28" returned: 0 in 0.248s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2779a7d3-c4c4-4a30-a463-1140efaa4c7f tempest-VolumesImageMetadata-337877688 None] Lock "cinder-quobyte-c470c552-0987-46ef-8be5-0c7b82461c28" released by "delete_volume" :: held 0.711s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:54 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-2779a7d3-c4c4-4a30-a463-1140efaa4c7f tempest-VolumesImageMetadata-337877688 None] Created reservations ['d9924920-6cdc-484f-8443-590cfd0e3b10', '7d907f64-8616-4ef2-be73-334baa04502b', '1cab53e4-ecd6-4eeb-98a0-8953964dfd5a', 'e89713f0-f306-4b12-b1f0-e363744a6872'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:54 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61" returned: 0 in 0.392s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:46:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:46:54 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Path /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e359ef98-bb0b-4114-9e17-e09ea3060e88 not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:46:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e359ef98-bb0b-4114-9e17-e09ea3060e88 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2779a7d3-c4c4-4a30-a463-1140efaa4c7f tempest-VolumesImageMetadata-337877688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2779a7d3-c4c4-4a30-a463-1140efaa4c7f tempest-VolumesImageMetadata-337877688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2779a7d3-c4c4-4a30-a463-1140efaa4c7f tempest-VolumesImageMetadata-337877688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2779a7d3-c4c4-4a30-a463-1140efaa4c7f tempest-VolumesImageMetadata-337877688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2779a7d3-c4c4-4a30-a463-1140efaa4c7f tempest-VolumesImageMetadata-337877688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2779a7d3-c4c4-4a30-a463-1140efaa4c7f tempest-VolumesImageMetadata-337877688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:54 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e359ef98-bb0b-4114-9e17-e09ea3060e88 Nov 02 10:46:54 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:54 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:46:54 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:54 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2779a7d3-c4c4-4a30-a463-1140efaa4c7f tempest-VolumesImageMetadata-337877688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.292s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:54 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-2779a7d3-c4c4-4a30-a463-1140efaa4c7f tempest-VolumesImageMetadata-337877688 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2779a7d3-c4c4-4a30-a463-1140efaa4c7f tempest-VolumesImageMetadata-337877688 None] Deleted volume successfully. Nov 02 10:46:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2779a7d3-c4c4-4a30-a463-1140efaa4c7f tempest-VolumesImageMetadata-337877688 None] Lock "cinder-c470c552-0987-46ef-8be5-0c7b82461c28-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b0cc96cd-6339-40ef-ae16-67d34692fa28 tempest-GroupSnapshotsTest-1904442589 None] Group tempest-GroupSnapshotsTest-Group-1865271857: creating Nov 02 10:46:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b0cc96cd-6339-40ef-ae16-67d34692fa28 tempest-GroupSnapshotsTest-1904442589 None] Group tempest-GroupSnapshotsTest-Group-1865271857: created successfully Nov 02 10:46:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b0cc96cd-6339-40ef-ae16-67d34692fa28 tempest-GroupSnapshotsTest-1904442589 None] Create group completed successfully. Nov 02 10:46:59 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Flow 'volume_create_manager' (cf59aa27-7b6e-4223-95ee-17cba474f0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d06f82-200e-4647-980c-8a39ee09d9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d06f82-200e-4647-980c-8a39ee09d9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1017620411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=efe5475c-b789-48f2-af1f-df0155846094,host='devstack@QuobyteHD#QuobyteHD',id=e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f562055a548049e7bcf745ed39e55969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:00Z,use_quota=True,user_id='86d438cf9cc042dc995c288b2c62d4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8de9857-5eb9-4fba-a098-bcaf3fd78b35),volume_type_id=f8de9857-5eb9-4fba-a098-bcaf3fd78b35)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af139cba-afac-4e49-8eef-f91ddb980a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af139cba-afac-4e49-8eef-f91ddb980a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a078b29-1527-4685-8b77-15ca7dbf6e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a078b29-1527-4685-8b77-15ca7dbf6e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf', 'volume_name': 'volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817bc671-e11f-4969-9c2b-ae59a18d6c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817bc671-e11f-4969-9c2b-ae59a18d6c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5dc55e-1f3a-4f6b-ae4e-6b51c643bded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:00 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Volume e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf', 'volume_size': 1} Nov 02 10:47:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:02 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e359ef98-bb0b-4114-9e17-e09ea3060e88" returned: 0 in 8.154s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:02 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Image conversion details: src /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61, size 1024.00 MB, duration 8.16 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e359ef98-bb0b-4114-9e17-e09ea3060e88 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:47:02 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Converted 1024.00 MB image at 125.55 MB/s Nov 02 10:47:02 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e359ef98-bb0b-4114-9e17-e09ea3060e88 is being set with open permissions: ugo+rw Nov 02 10:47:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e359ef98-bb0b-4114-9e17-e09ea3060e88 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:02 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e359ef98-bb0b-4114-9e17-e09ea3060e88 Nov 02 10:47:02 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:02 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e359ef98-bb0b-4114-9e17-e09ea3060e88" returned: 0 in 0.238s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Lock "cinder-quobyte-e359ef98-bb0b-4114-9e17-e09ea3060e88" released by "_copy_volume_from_snapshot" :: held 9.336s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Acquiring lock "cinder-quobyte-7974c905-d16f-4fca-9a26-1773d2ed6a26" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Lock "cinder-quobyte-7974c905-d16f-4fca-9a26-1773d2ed6a26" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Deleting offline snapshot 7974c905-d16f-4fca-9a26-1773d2ed6a26 of volume b9cf2042-4017-4eaa-b267-39c6d48bcd61 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:47:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] snapshot_file for this snap is: volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:47:02 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d26a657-9e76-41bf-8981-bbb61bf07265]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:02 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26 Nov 02 10:47:02 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:03 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26" returned: 0 in 0.390s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:47:03 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e00adda-60fb-4a0b-83b9-cc44d3fcf1af]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:03 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 Nov 02 10:47:03 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:03 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61" returned: 0 in 0.512s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:03 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26 Nov 02 10:47:03 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:04 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26" returned: 0 in 0.357s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:04 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26 Nov 02 10:47:04 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:04 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61.7974c905-d16f-4fca-9a26-1773d2ed6a26" returned: 0 in 0.273s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Lock "cinder-quobyte-7974c905-d16f-4fca-9a26-1773d2ed6a26" released by "_delete_snapshot" :: held 1.634s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.572s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.924s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0deb067c-52c6-4499-984c-707c51f0fa43,created_at=2026-11-02T09:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1467159775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0deb067c-52c6-4499-984c-707c51f0fa43,host='devstack@QuobyteHD#QuobyteHD',id=a4b6b717-cee1-46f2-8cdd-f4013c74f422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c3bd4b89d54638a246d445245dae9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:51Z,use_quota=True,user_id='5925a013525b458ab25c2b1f66be849f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc5eba55-4732-4c5f-aa56-e9271d23fac2),volume_type_id=fc5eba55-4732-4c5f-aa56-e9271d23fac2)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Creating volume a4b6b717-cee1-46f2-8cdd-f4013c74f422 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:04 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7ec707-f0c3-42a9-b076-dac0c5ea4b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e359ef98-bb0b-4114-9e17-e09ea3060e88', 'volume_size': 1, 'source_volid': 'b9cf2042-4017-4eaa-b267-39c6d48bcd61', 'source_volstatus': 'available'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be5628fb-a276-4664-8929-9f218525666f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:04 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422 1073741824 Nov 02 10:47:04 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:04 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Volume volume-e359ef98-bb0b-4114-9e17-e09ea3060e88 (e359ef98-bb0b-4114-9e17-e09ea3060e88): created successfully Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be5628fb-a276-4664-8929-9f218525666f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Flow 'volume_create_manager' (795be777-5615-42d6-85e2-dd63bad79f16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:04 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ee4c3c57-7ee4-462c-a196-0aeec2fa9da4 tempest-VolumesGetTest-1115319392 None] Created volume successfully. Nov 02 10:47:04 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422 1073741824" returned: 0 in 0.445s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:04 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422 Nov 02 10:47:04 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:05 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422" returned: 0 in 0.266s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:47:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.150s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=efe5475c-b789-48f2-af1f-df0155846094,created_at=2026-11-02T09:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1017620411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=efe5475c-b789-48f2-af1f-df0155846094,host='devstack@QuobyteHD#QuobyteHD',id=e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f562055a548049e7bcf745ed39e55969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:00Z,use_quota=True,user_id='86d438cf9cc042dc995c288b2c62d4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8de9857-5eb9-4fba-a098-bcaf3fd78b35),volume_type_id=f8de9857-5eb9-4fba-a098-bcaf3fd78b35)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:47:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Creating volume e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:47:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:05 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:47:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:05 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf 1073741824 Nov 02 10:47:05 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f65bba-6ec0-43ed-a22f-64378a836d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e26e3e-04b9-43ff-996c-73e667e3abac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:05 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Volume volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422 (a4b6b717-cee1-46f2-8cdd-f4013c74f422): created successfully Nov 02 10:47:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e26e3e-04b9-43ff-996c-73e667e3abac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Flow 'volume_create_manager' (397c4baf-33fe-4c6a-b404-3ec4176fe020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:05 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5fad77f2-4115-46c6-9092-2dd2abdefbae tempest-GroupSnapshotsV319Test-1447030872 None] Created volume successfully. Nov 02 10:47:05 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf 1073741824" returned: 0 in 0.713s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:06 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf Nov 02 10:47:06 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Flow 'volume_create_manager' (848152c0-ef93-415a-b417-8ba989dd14ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4a1593-a1ef-4c59-a69c-a3dd703beea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4a1593-a1ef-4c59-a69c-a3dd703beea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1393595022',display_name='tempest-VolumesGetTest-Volume-1735413795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1864e013-d25b-42f5-bcd8-a3975337efd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0ef435b4c94e729346b963a40ef057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:06Z,use_quota=True,user_id='3e5f499a875d4866a250710c3ed390f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (305b2b2a-c052-41dc-9b1e-3a7b9eeb4911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (305b2b2a-c052-41dc-9b1e-3a7b9eeb4911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe30335-eee5-45bd-942c-ddcf51bb5324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe30335-eee5-45bd-942c-ddcf51bb5324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1864e013-d25b-42f5-bcd8-a3975337efd5', 'volume_name': 'volume-1864e013-d25b-42f5-bcd8-a3975337efd5', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b04293-19f0-4544-ae83-306638ae3f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b04293-19f0-4544-ae83-306638ae3f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b50e42-fd76-4d6b-8efa-2e0965bd4252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:06 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Volume 1864e013-d25b-42f5-bcd8-a3975337efd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1864e013-d25b-42f5-bcd8-a3975337efd5', 'volume_size': 1} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:06 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf" returned: 0 in 0.271s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.044s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1393595022',display_name='tempest-VolumesGetTest-Volume-1735413795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1864e013-d25b-42f5-bcd8-a3975337efd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0ef435b4c94e729346b963a40ef057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:06Z,use_quota=True,user_id='3e5f499a875d4866a250710c3ed390f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Creating volume 1864e013-d25b-42f5-bcd8-a3975337efd5 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:06 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1864e013-d25b-42f5-bcd8-a3975337efd5 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5dc55e-1f3a-4f6b-ae4e-6b51c643bded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42b73b9-4054-486b-8e85-f1e74738fecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:06 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1864e013-d25b-42f5-bcd8-a3975337efd5 1073741824 Nov 02 10:47:06 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:06 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Volume volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf (e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf): created successfully Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42b73b9-4054-486b-8e85-f1e74738fecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Flow 'volume_create_manager' (cf59aa27-7b6e-4223-95ee-17cba474f0aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:06 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1cead62c-fef6-490f-8a7c-9c8b002cb0c0 tempest-GroupSnapshotsTest-1904442589 None] Created volume successfully. Nov 02 10:47:06 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] GroupSnapshot e8ff53ae-3130-4213-94c6-1c746f9da606: creating. Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] Group snapshot e8ff53ae-3130-4213-94c6-1c746f9da606: creating. {{(pid=87084) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:06 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1864e013-d25b-42f5-bcd8-a3975337efd5 1073741824" returned: 0 in 0.559s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1864e013-d25b-42f5-bcd8-a3975337efd5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:06 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1864e013-d25b-42f5-bcd8-a3975337efd5 Nov 02 10:47:06 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:07 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1864e013-d25b-42f5-bcd8-a3975337efd5" returned: 0 in 0.286s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:47:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.433s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b50e42-fd76-4d6b-8efa-2e0965bd4252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1864e013-d25b-42f5-bcd8-a3975337efd5', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d692c592-5144-492f-b8eb-4f1275d99f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] Creating offline snapshot ffa392c6-7fea-4320-9573-3e85dab5caf3 of volume a4b6b717-cee1-46f2-8cdd-f4013c74f422 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:47:07 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Volume volume-1864e013-d25b-42f5-bcd8-a3975337efd5 (1864e013-d25b-42f5-bcd8-a3975337efd5): created successfully Nov 02 10:47:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d692c592-5144-492f-b8eb-4f1275d99f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Flow 'volume_create_manager' (848152c0-ef93-415a-b417-8ba989dd14ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:07 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[918b2c8c-47e0-4847-b190-9f90644ff990]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:07 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c860089d-a332-410a-8881-7c18c4851cec tempest-VolumesGetTest-1115319392 None] Created volume successfully. Nov 02 10:47:07 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422 Nov 02 10:47:07 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:07 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] GroupSnapshot 73777fb4-10ed-412c-93f2-cb251d17c9de: creating. Nov 02 10:47:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] Group snapshot 73777fb4-10ed-412c-93f2-cb251d17c9de: creating. {{(pid=87084) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:47:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:07 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422" returned: 0 in 0.416s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.ffa392c6-7fea-4320-9573-3e85dab5caf3 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:07 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.ffa392c6-7fea-4320-9573-3e85dab5caf3 1G Nov 02 10:47:07 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:08 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.ffa392c6-7fea-4320-9573-3e85dab5caf3 1G" returned: 0 in 0.452s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.ffa392c6-7fea-4320-9573-3e85dab5caf3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:08 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.ffa392c6-7fea-4320-9573-3e85dab5caf3 Nov 02 10:47:08 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0ab1235f-4429-4bc8-9e52-8f52b372dd80 tempest-VolumesGetTest-1115319392 None] Acquiring lock "cinder-1864e013-d25b-42f5-bcd8-a3975337efd5-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0ab1235f-4429-4bc8-9e52-8f52b372dd80 tempest-VolumesGetTest-1115319392 None] Lock "cinder-1864e013-d25b-42f5-bcd8-a3975337efd5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0ab1235f-4429-4bc8-9e52-8f52b372dd80 tempest-VolumesGetTest-1115319392 None] Acquiring lock "cinder-quobyte-1864e013-d25b-42f5-bcd8-a3975337efd5" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0ab1235f-4429-4bc8-9e52-8f52b372dd80 tempest-VolumesGetTest-1115319392 None] Lock "cinder-quobyte-1864e013-d25b-42f5-bcd8-a3975337efd5" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:08 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.ffa392c6-7fea-4320-9573-3e85dab5caf3" returned: 0 in 0.464s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:08 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.ffa392c6-7fea-4320-9573-3e85dab5caf3 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:47:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.ffa392c6-7fea-4320-9573-3e85dab5caf3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:08 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04c5d5a-7354-4692-8a5b-43627fc70432]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0ab1235f-4429-4bc8-9e52-8f52b372dd80 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1864e013-d25b-42f5-bcd8-a3975337efd5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:08 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.ffa392c6-7fea-4320-9573-3e85dab5caf3 Nov 02 10:47:08 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:08 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1864e013-d25b-42f5-bcd8-a3975337efd5 Nov 02 10:47:08 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:08 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.ffa392c6-7fea-4320-9573-3e85dab5caf3" returned: 0 in 0.304s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:08 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.info Nov 02 10:47:08 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:09 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0ab1235f-4429-4bc8-9e52-8f52b372dd80 tempest-VolumesGetTest-1115319392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1864e013-d25b-42f5-bcd8-a3975337efd5" returned: 0 in 0.447s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0ab1235f-4429-4bc8-9e52-8f52b372dd80 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1864e013-d25b-42f5-bcd8-a3975337efd5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:09 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1864e013-d25b-42f5-bcd8-a3975337efd5 Nov 02 10:47:09 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:09 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.info" returned: 0 in 0.268s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:09 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:09 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.info Nov 02 10:47:09 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:09 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0ab1235f-4429-4bc8-9e52-8f52b372dd80 tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1864e013-d25b-42f5-bcd8-a3975337efd5" returned: 0 in 0.284s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0ab1235f-4429-4bc8-9e52-8f52b372dd80 tempest-VolumesGetTest-1115319392 None] Lock "cinder-quobyte-1864e013-d25b-42f5-bcd8-a3975337efd5" released by "delete_volume" :: held 0.792s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-0ab1235f-4429-4bc8-9e52-8f52b372dd80 tempest-VolumesGetTest-1115319392 None] Created reservations ['b3fbeb25-4d77-40d8-a7c4-b9e624e4568a', '22153d28-d0f7-4ca5-b7fd-acd2d9ce74d0', '86c94d97-82a5-4791-920b-2e0152dbeda6', '6d9cf3fb-f2ff-4c7d-b114-9d2ab4f4bb98'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:09 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0ab1235f-4429-4bc8-9e52-8f52b372dd80 tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0ab1235f-4429-4bc8-9e52-8f52b372dd80 tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0ab1235f-4429-4bc8-9e52-8f52b372dd80 tempest-VolumesGetTest-1115319392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0ab1235f-4429-4bc8-9e52-8f52b372dd80 tempest-VolumesGetTest-1115319392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0ab1235f-4429-4bc8-9e52-8f52b372dd80 tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0ab1235f-4429-4bc8-9e52-8f52b372dd80 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.info" returned: 0 in 0.322s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:09 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:47:09 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.377s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.107s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] Creating offline snapshot 770c9a0c-d098-4ac0-80d3-52753d6b3879 of volume e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df4f7ce-d2c6-408f-885a-6c10656a1e08]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:09 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5c1521ee-ce19-4b51-96a9-ed372c2444e3 tempest-GroupSnapshotsV319Test-1447030872 None] group_snapshot e8ff53ae-3130-4213-94c6-1c746f9da606: created successfully Nov 02 10:47:09 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf Nov 02 10:47:09 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a7b7dabd-739f-4ad9-8919-d968311068fe tempest-VolumesGetTest-1115319392 None] Acquiring lock "cinder-e359ef98-bb0b-4114-9e17-e09ea3060e88-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a7b7dabd-739f-4ad9-8919-d968311068fe tempest-VolumesGetTest-1115319392 None] Lock "cinder-e359ef98-bb0b-4114-9e17-e09ea3060e88-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:09 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0ab1235f-4429-4bc8-9e52-8f52b372dd80 tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.367s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-0ab1235f-4429-4bc8-9e52-8f52b372dd80 tempest-VolumesGetTest-1115319392 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a7b7dabd-739f-4ad9-8919-d968311068fe tempest-VolumesGetTest-1115319392 None] Acquiring lock "cinder-quobyte-e359ef98-bb0b-4114-9e17-e09ea3060e88" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:09 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0ab1235f-4429-4bc8-9e52-8f52b372dd80 tempest-VolumesGetTest-1115319392 None] Deleted volume successfully. Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a7b7dabd-739f-4ad9-8919-d968311068fe tempest-VolumesGetTest-1115319392 None] Lock "cinder-quobyte-e359ef98-bb0b-4114-9e17-e09ea3060e88" acquired by "delete_volume" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0ab1235f-4429-4bc8-9e52-8f52b372dd80 tempest-VolumesGetTest-1115319392 None] Lock "cinder-1864e013-d25b-42f5-bcd8-a3975337efd5-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cce305-b6a3-4d54-9854-bc2d04777a63]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a7b7dabd-739f-4ad9-8919-d968311068fe tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e359ef98-bb0b-4114-9e17-e09ea3060e88 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:10 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e359ef98-bb0b-4114-9e17-e09ea3060e88 Nov 02 10:47:10 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:10 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf" returned: 0 in 0.499s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:10 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879 1G Nov 02 10:47:10 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:10 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a7b7dabd-739f-4ad9-8919-d968311068fe tempest-VolumesGetTest-1115319392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e359ef98-bb0b-4114-9e17-e09ea3060e88" returned: 0 in 0.566s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a7b7dabd-739f-4ad9-8919-d968311068fe tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e359ef98-bb0b-4114-9e17-e09ea3060e88 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:10 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e359ef98-bb0b-4114-9e17-e09ea3060e88 Nov 02 10:47:10 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:10 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879 1G" returned: 0 in 0.593s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:10 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879 Nov 02 10:47:10 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:10 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] group_snapshot e8ff53ae-3130-4213-94c6-1c746f9da606: deleting Nov 02 10:47:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] group_snapshot e8ff53ae-3130-4213-94c6-1c746f9da606: deleting {{(pid=87084) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:47:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] Acquiring lock "cinder-quobyte-a4b6b717-cee1-46f2-8cdd-f4013c74f422" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:10 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a7b7dabd-739f-4ad9-8919-d968311068fe tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e359ef98-bb0b-4114-9e17-e09ea3060e88" returned: 0 in 0.453s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] Lock "cinder-quobyte-a4b6b717-cee1-46f2-8cdd-f4013c74f422" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] Acquiring lock "cinder-quobyte-ffa392c6-7fea-4320-9573-3e85dab5caf3" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a7b7dabd-739f-4ad9-8919-d968311068fe tempest-VolumesGetTest-1115319392 None] Lock "cinder-quobyte-e359ef98-bb0b-4114-9e17-e09ea3060e88" released by "delete_volume" :: held 1.110s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] Lock "cinder-quobyte-ffa392c6-7fea-4320-9573-3e85dab5caf3" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] Deleting offline snapshot ffa392c6-7fea-4320-9573-3e85dab5caf3 of volume a4b6b717-cee1-46f2-8cdd-f4013c74f422 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] snapshot_file for this snap is: volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.ffa392c6-7fea-4320-9573-3e85dab5caf3 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8275e159-8fb6-4eea-8da1-bf221e3cd720]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.ffa392c6-7fea-4320-9573-3e85dab5caf3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a7b7dabd-739f-4ad9-8919-d968311068fe tempest-VolumesGetTest-1115319392 None] Created reservations ['be7c6a90-a41f-48da-b3df-a5a44e12a951', 'c877aea5-9cb3-4fe2-8327-4dfeab1b1308', 'a6cd66cb-143c-42fc-bf16-4f0557b710ea', 'b2b7cc94-1b44-40c9-a74d-d2eb48f01715'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:11 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879" returned: 0 in 0.502s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:11 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:11 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879 Nov 02 10:47:11 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:11 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.ffa392c6-7fea-4320-9573-3e85dab5caf3 Nov 02 10:47:11 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a7b7dabd-739f-4ad9-8919-d968311068fe tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a7b7dabd-739f-4ad9-8919-d968311068fe tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a7b7dabd-739f-4ad9-8919-d968311068fe tempest-VolumesGetTest-1115319392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a7b7dabd-739f-4ad9-8919-d968311068fe tempest-VolumesGetTest-1115319392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a7b7dabd-739f-4ad9-8919-d968311068fe tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a7b7dabd-739f-4ad9-8919-d968311068fe tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:11 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:47:11 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:11 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879" returned: 0 in 0.415s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:11 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.info Nov 02 10:47:11 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:11 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.ffa392c6-7fea-4320-9573-3e85dab5caf3" returned: 0 in 0.661s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:47:11 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a7b7dabd-739f-4ad9-8919-d968311068fe tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.454s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-a7b7dabd-739f-4ad9-8919-d968311068fe tempest-VolumesGetTest-1115319392 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8f78e6-a165-4766-8c76-9463a243ee74]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:11 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a7b7dabd-739f-4ad9-8919-d968311068fe tempest-VolumesGetTest-1115319392 None] Deleted volume successfully. Nov 02 10:47:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a7b7dabd-739f-4ad9-8919-d968311068fe tempest-VolumesGetTest-1115319392 None] Lock "cinder-e359ef98-bb0b-4114-9e17-e09ea3060e88-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:11 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422 Nov 02 10:47:11 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:12 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.info" returned: 0 in 0.381s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:12 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:47:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:12 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.info Nov 02 10:47:12 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3397f3be-9f8f-4f49-84db-72db61790c9b tempest-VolumesGetTest-1115319392 None] Acquiring lock "cinder-b9cf2042-4017-4eaa-b267-39c6d48bcd61-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3397f3be-9f8f-4f49-84db-72db61790c9b tempest-VolumesGetTest-1115319392 None] Lock "cinder-b9cf2042-4017-4eaa-b267-39c6d48bcd61-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3397f3be-9f8f-4f49-84db-72db61790c9b tempest-VolumesGetTest-1115319392 None] Acquiring lock "cinder-quobyte-b9cf2042-4017-4eaa-b267-39c6d48bcd61" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3397f3be-9f8f-4f49-84db-72db61790c9b tempest-VolumesGetTest-1115319392 None] Lock "cinder-quobyte-b9cf2042-4017-4eaa-b267-39c6d48bcd61" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:12 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422" returned: 0 in 0.522s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.ffa392c6-7fea-4320-9573-3e85dab5caf3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:12 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee13bed8-341b-434e-a6ea-13dc67cccf65]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3397f3be-9f8f-4f49-84db-72db61790c9b tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:12 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.ffa392c6-7fea-4320-9573-3e85dab5caf3 Nov 02 10:47:12 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:12 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.info" returned: 0 in 0.367s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.914s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:12 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 Nov 02 10:47:12 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:12 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d8942005-6483-45d0-b6d1-7b83de851129 tempest-GroupSnapshotsTest-1904442589 None] group_snapshot 73777fb4-10ed-412c-93f2-cb251d17c9de: created successfully Nov 02 10:47:12 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.ffa392c6-7fea-4320-9573-3e85dab5caf3" returned: 0 in 0.405s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.ffa392c6-7fea-4320-9573-3e85dab5caf3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:12 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.ffa392c6-7fea-4320-9573-3e85dab5caf3 Nov 02 10:47:12 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:12 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3397f3be-9f8f-4f49-84db-72db61790c9b tempest-VolumesGetTest-1115319392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61" returned: 0 in 0.487s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3397f3be-9f8f-4f49-84db-72db61790c9b tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:12 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61 Nov 02 10:47:12 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:13 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422.ffa392c6-7fea-4320-9573-3e85dab5caf3" returned: 0 in 0.315s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] Lock "cinder-quobyte-ffa392c6-7fea-4320-9573-3e85dab5caf3" released by "_delete_snapshot" :: held 2.079s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] Lock "cinder-quobyte-a4b6b717-cee1-46f2-8cdd-f4013c74f422" released by "delete_snapshot" :: held 2.127s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:13 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Flow 'volume_create_manager' (ffa20182-2526-4d15-a5b0-b7605eb3509c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94268684-075a-49a4-8e05-dcd0f3162cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3397f3be-9f8f-4f49-84db-72db61790c9b tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9cf2042-4017-4eaa-b267-39c6d48bcd61" returned: 0 in 0.438s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94268684-075a-49a4-8e05-dcd0f3162cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1706077752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=150779b5-40c5-4c7c-bed5-f253ca9b2ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab05d44dee84c948f961afddcd9cf79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:13Z,use_quota=True,user_id='defd1f3775c5481ca9f0649c90185650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03a9844-542e-4a47-aa71-bf5f8652921d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03a9844-542e-4a47-aa71-bf5f8652921d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450b2569-7da5-4653-8921-c0e000835f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450b2569-7da5-4653-8921-c0e000835f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '150779b5-40c5-4c7c-bed5-f253ca9b2ce1', 'volume_name': 'volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea3934f-bac9-4a0c-9d21-c6a5a751b372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea3934f-bac9-4a0c-9d21-c6a5a751b372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d71f6c-344d-473b-86fd-727daef47d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:13 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Volume 150779b5-40c5-4c7c-bed5-f253ca9b2ce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1', 'volume_size': 1} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1706077752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=150779b5-40c5-4c7c-bed5-f253ca9b2ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab05d44dee84c948f961afddcd9cf79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:13Z,use_quota=True,user_id='defd1f3775c5481ca9f0649c90185650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Creating volume 150779b5-40c5-4c7c-bed5-f253ca9b2ce1 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:13 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3397f3be-9f8f-4f49-84db-72db61790c9b tempest-VolumesGetTest-1115319392 None] Lock "cinder-quobyte-b9cf2042-4017-4eaa-b267-39c6d48bcd61" released by "delete_volume" :: held 1.109s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:13 devstack cinder-volume[87084]: WARNING cinder.quota [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2015082340 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2015082340, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:47:13 devstack cinder-volume[87084]: WARNING cinder.quota [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2015082340 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2015082340, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:47:13 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 1073741824 Nov 02 10:47:13 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] Created reservations ['0259bc13-1cfc-469e-9cc8-3918563b17b7', 'd6ce5d4a-47c4-4ede-8e12-e1fc94971395', '33101cdc-2609-4c46-9064-890bf8b2b871', 'b7d0edad-cd1b-4908-90c8-14b1877dd7df'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-3397f3be-9f8f-4f49-84db-72db61790c9b tempest-VolumesGetTest-1115319392 None] Created reservations ['dfc1797f-5694-44b0-a0cc-187f4e18364c', '74aabd85-0365-440e-a20a-9c3673ddf2ad', '920a9453-377c-4918-89bb-7b0a16d92d7a', '12a0793b-65e2-493e-850e-9a77b259110e'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:13 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6451da89-334f-41ca-ab02-f048da48cfad tempest-GroupSnapshotsV319Test-1447030872 None] group_snapshot e8ff53ae-3130-4213-94c6-1c746f9da606: deleted successfully Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3397f3be-9f8f-4f49-84db-72db61790c9b tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3397f3be-9f8f-4f49-84db-72db61790c9b tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3397f3be-9f8f-4f49-84db-72db61790c9b tempest-VolumesGetTest-1115319392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3397f3be-9f8f-4f49-84db-72db61790c9b tempest-VolumesGetTest-1115319392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3397f3be-9f8f-4f49-84db-72db61790c9b tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3397f3be-9f8f-4f49-84db-72db61790c9b tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:13 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:47:13 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:13 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3397f3be-9f8f-4f49-84db-72db61790c9b tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.293s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-3397f3be-9f8f-4f49-84db-72db61790c9b tempest-VolumesGetTest-1115319392 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:13 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3397f3be-9f8f-4f49-84db-72db61790c9b tempest-VolumesGetTest-1115319392 None] Deleted volume successfully. Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:13 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3397f3be-9f8f-4f49-84db-72db61790c9b tempest-VolumesGetTest-1115319392 None] Lock "cinder-b9cf2042-4017-4eaa-b267-39c6d48bcd61-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 1073741824" returned: 0 in 0.549s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:13 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 Nov 02 10:47:13 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:14 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1" returned: 0 in 0.239s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.282s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "cinder-quobyte-770c9a0c-d098-4ac0-80d3-52753d6b3879-0993fd4f-b1c9-4d9b-8327-35bc829c0811" by "_create_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d71f6c-344d-473b-86fd-727daef47d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de486c12-4e1b-492b-92ca-9548a9a3efb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-770c9a0c-d098-4ac0-80d3-52753d6b3879-0993fd4f-b1c9-4d9b-8327-35bc829c0811" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Creating volume 0993fd4f-b1c9-4d9b-8327-35bc829c0811 from snapshot 770c9a0c-d098-4ac0-80d3-52753d6b3879 {{(pid=87084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "cinder-quobyte-0993fd4f-b1c9-4d9b-8327-35bc829c0811" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:14 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Volume volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 (150779b5-40c5-4c7c-bed5-f253ca9b2ce1): created successfully Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de486c12-4e1b-492b-92ca-9548a9a3efb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Flow 'volume_create_manager' (ffa20182-2526-4d15-a5b0-b7605eb3509c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-0993fd4f-b1c9-4d9b-8327-35bc829c0811" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] snapshot: 770c9a0c-d098-4ac0-80d3-52753d6b3879, volume: 0993fd4f-b1c9-4d9b-8327-35bc829c0811, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:47:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-519d13ff-aa5f-47ff-b820-51f68bdf4ee1 tempest-VolumesActionsTest-1313225901 None] Created volume successfully. Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b43162-071f-45a7-9663-b6e21f478798]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:14 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879 Nov 02 10:47:14 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:14 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c7db9df4-6069-449f-a269-e98bd5b7fb90 tempest-GroupSnapshotsV319Test-1447030872 None] Acquiring lock "cinder-quobyte-a4b6b717-cee1-46f2-8cdd-f4013c74f422" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879" returned: 0 in 0.415s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c7db9df4-6069-449f-a269-e98bd5b7fb90 tempest-GroupSnapshotsV319Test-1447030872 None] Lock "cinder-quobyte-a4b6b717-cee1-46f2-8cdd-f4013c74f422" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48efcd2-6201-421d-b1a7-795ef722841f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e46b71c-1005-4f29-85cc-9de33ff67f50]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c7db9df4-6069-449f-a269-e98bd5b7fb90 tempest-GroupSnapshotsV319Test-1447030872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:14 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf Nov 02 10:47:14 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:14 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422 Nov 02 10:47:14 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:15 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:47:15 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Flow 'volume_create_manager' (fa57eaae-6947-4915-99dc-c5cf033ed594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c69e29-97a0-4a31-8e23-bf62a2abe460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf" returned: 0 in 0.476s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Path /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0993fd4f-b1c9-4d9b-8327-35bc829c0811 not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0993fd4f-b1c9-4d9b-8327-35bc829c0811 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c7db9df4-6069-449f-a269-e98bd5b7fb90 tempest-GroupSnapshotsV319Test-1447030872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422" returned: 0 in 0.476s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c7db9df4-6069-449f-a269-e98bd5b7fb90 tempest-GroupSnapshotsV319Test-1447030872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:15 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0993fd4f-b1c9-4d9b-8327-35bc829c0811 Nov 02 10:47:15 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c69e29-97a0-4a31-8e23-bf62a2abe460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-586870109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87b19c8-e0a8-465b-8506-1b4123b66f6a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e0ef435b4c94e729346b963a40ef057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:15Z,use_quota=True,user_id='3e5f499a875d4866a250710c3ed390f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c1f5c04-a9e5-4a1d-9097-3f988993ed77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c1f5c04-a9e5-4a1d-9097-3f988993ed77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:15 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422 Nov 02 10:47:15 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38e462d-03a6-416f-a7cd-658a428a68ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG cinder.image.glance [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Creating Keystone auth plugin from conf {{(pid=87084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:47:15 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c7db9df4-6069-449f-a269-e98bd5b7fb90 tempest-GroupSnapshotsV319Test-1447030872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a4b6b717-cee1-46f2-8cdd-f4013c74f422" returned: 0 in 0.379s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c7db9df4-6069-449f-a269-e98bd5b7fb90 tempest-GroupSnapshotsV319Test-1447030872 None] Lock "cinder-quobyte-a4b6b717-cee1-46f2-8cdd-f4013c74f422" released by "delete_volume" :: held 0.937s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38e462d-03a6-416f-a7cd-658a428a68ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a87b19c8-e0a8-465b-8506-1b4123b66f6a', 'volume_name': 'volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a', 'volume_size': 1, 'image_id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9af457eb3c6844a99ee880354ae43eac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'created_at': datetime.datetime(2026, 11, 2, 9, 33, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0223-61d3-44de-a27f-c6e0b6ba1310/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0972376c-a315-4bd8-9958-7706c54ef321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0972376c-a315-4bd8-9958-7706c54ef321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0022e1-75ec-48a9-97f4-3dec387a5cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:15 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Volume a87b19c8-e0a8-465b-8506-1b4123b66f6a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a', 'volume_size': 1, 'image_id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9af457eb3c6844a99ee880354ae43eac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'created_at': datetime.datetime(2026, 11, 2, 9, 33, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0223-61d3-44de-a27f-c6e0b6ba1310/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Trying to clone a87b19c8-e0a8-465b-8506-1b4123b66f6a from image 918d0223-61d3-44de-a27f-c6e0b6ba1310 at location (None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}]). {{(pid=87084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c7db9df4-6069-449f-a269-e98bd5b7fb90 tempest-GroupSnapshotsV319Test-1447030872 None] Created reservations ['551706e9-dfdd-4bbd-abe9-a1fe4e6c2377'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:15 devstack cinder-volume[87084]: WARNING cinder.quota [None req-c7db9df4-6069-449f-a269-e98bd5b7fb90 tempest-GroupSnapshotsV319Test-1447030872 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2015082340 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2015082340, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:47:15 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c7db9df4-6069-449f-a269-e98bd5b7fb90 tempest-GroupSnapshotsV319Test-1447030872 None] Created reservations ['9f13a821-3e61-41d9-a1ce-938bfb0b07ad', '404eb750-5b5b-414c-aece-6aded64596bf', 'e8b6c8d4-7a63-4e3a-9688-2182d1ea1efe', '381d8449-1246-44cb-862b-506a080159eb'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c7db9df4-6069-449f-a269-e98bd5b7fb90 tempest-GroupSnapshotsV319Test-1447030872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c7db9df4-6069-449f-a269-e98bd5b7fb90 tempest-GroupSnapshotsV319Test-1447030872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c7db9df4-6069-449f-a269-e98bd5b7fb90 tempest-GroupSnapshotsV319Test-1447030872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c7db9df4-6069-449f-a269-e98bd5b7fb90 tempest-GroupSnapshotsV319Test-1447030872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c7db9df4-6069-449f-a269-e98bd5b7fb90 tempest-GroupSnapshotsV319Test-1447030872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c7db9df4-6069-449f-a269-e98bd5b7fb90 tempest-GroupSnapshotsV319Test-1447030872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:16 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:47:16 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:16 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_khuoq4bsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:47:16 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:47:16 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8811e829-889c-49d9-9e12-8a1b353ca805]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_khuoq4bsdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:16 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_khuoq4bsdevstack@QuobyteHD Nov 02 10:47:16 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:16 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c7db9df4-6069-449f-a269-e98bd5b7fb90 tempest-GroupSnapshotsV319Test-1447030872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.686s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:16 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c7db9df4-6069-449f-a269-e98bd5b7fb90 tempest-GroupSnapshotsV319Test-1447030872 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:16 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c7db9df4-6069-449f-a269-e98bd5b7fb90 tempest-GroupSnapshotsV319Test-1447030872 None] Delete group completed successfully. Nov 02 10:47:17 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_khuoq4bsdevstack@QuobyteHD" returned: 0 in 0.744s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:17 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Temporary image 918d0223-61d3-44de-a27f-c6e0b6ba1310 is fetched for user 3e5f499a875d4866a250710c3ed390f4. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:47:17 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=144,cinder:INSERT=50,cinder:UPDATE=167,cinder:DELETE=13 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:47:17 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=133,cinder:INSERT=43,cinder:UPDATE=184,cinder:DELETE=15 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:47:17 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2280ef81-32fb-4f7b-a6c0-a00c7ef77a0a]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_khuoq4bsdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:17 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_khuoq4bsdevstack@QuobyteHD Nov 02 10:47:17 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:18 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_khuoq4bsdevstack@QuobyteHD" returned: 0 in 0.807s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:24 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0993fd4f-b1c9-4d9b-8327-35bc829c0811" returned: 0 in 9.372s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:24 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Image conversion details: src /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf, size 1024.00 MB, duration 9.37 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0993fd4f-b1c9-4d9b-8327-35bc829c0811 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:47:24 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Converted 1024.00 MB image at 109.25 MB/s Nov 02 10:47:24 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0993fd4f-b1c9-4d9b-8327-35bc829c0811 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:47:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0993fd4f-b1c9-4d9b-8327-35bc829c0811 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:24 devstack sudo[96396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0993fd4f-b1c9-4d9b-8327-35bc829c0811 Nov 02 10:47:24 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:25 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0993fd4f-b1c9-4d9b-8327-35bc829c0811" returned: 0 in 0.463s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-0993fd4f-b1c9-4d9b-8327-35bc829c0811" released by "_copy_volume_from_snapshot" :: held 10.866s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-770c9a0c-d098-4ac0-80d3-52753d6b3879-0993fd4f-b1c9-4d9b-8327-35bc829c0811" released by "_create_volume_from_snapshot" :: held 11.050s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.084s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.922s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-586870109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87b19c8-e0a8-465b-8506-1b4123b66f6a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e0ef435b4c94e729346b963a40ef057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:15Z,use_quota=True,user_id='3e5f499a875d4866a250710c3ed390f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:47:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Creating volume a87b19c8-e0a8-465b-8506-1b4123b66f6a {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:47:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:25 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:47:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:25 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a 1073741824 Nov 02 10:47:25 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:25 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7df75cb9-5dcb-4e9b-a0c2-71d00fa4fd04 tempest-GroupSnapshotsTest-1904442589 None] Create group from source-snapshot-73777fb4-10ed-412c-93f2-cb251d17c9de completed successfully. Nov 02 10:47:26 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a 1073741824" returned: 0 in 0.980s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:26 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a Nov 02 10:47:26 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:26 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a" returned: 0 in 0.370s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:47:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:26 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Attempting download of 918d0223-61d3-44de-a27f-c6e0b6ba1310 ((None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}])) to volume a87b19c8-e0a8-465b-8506-1b4123b66f6a. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:47:26 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fd2a42-e98e-4736-bdf9-fe0ffd396529]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_mq4osu4n {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:27 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_mq4osu4n Nov 02 10:47:27 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-84419866-6a76-40ab-8d9e-05ab1d951447 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "cinder-quobyte-0993fd4f-b1c9-4d9b-8327-35bc829c0811" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-84419866-6a76-40ab-8d9e-05ab1d951447 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-0993fd4f-b1c9-4d9b-8327-35bc829c0811" acquired by "delete_volume" :: waited 0.049s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:27 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[54173bab-6955-4413-a52c-c43dc57c2b8f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-84419866-6a76-40ab-8d9e-05ab1d951447 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0993fd4f-b1c9-4d9b-8327-35bc829c0811 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:27 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_mq4osu4n" returned: 0 in 0.741s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_mq4osu4n {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:27 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0993fd4f-b1c9-4d9b-8327-35bc829c0811 Nov 02 10:47:27 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:27 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_mq4osu4n Nov 02 10:47:27 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:28 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-84419866-6a76-40ab-8d9e-05ab1d951447 tempest-GroupSnapshotsTest-1904442589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0993fd4f-b1c9-4d9b-8327-35bc829c0811" returned: 0 in 0.575s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-84419866-6a76-40ab-8d9e-05ab1d951447 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0993fd4f-b1c9-4d9b-8327-35bc829c0811 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:28 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0993fd4f-b1c9-4d9b-8327-35bc829c0811 Nov 02 10:47:28 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:28 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_mq4osu4n" returned: 1 in 0.445s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310_mq4osu4n' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:47:28 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3534fd9d-4612-48d3-9912-37713db5f251]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_khuoq4bsdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:28 devstack sudo[96528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_khuoq4bsdevstack@QuobyteHD Nov 02 10:47:28 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:28 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-84419866-6a76-40ab-8d9e-05ab1d951447 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0993fd4f-b1c9-4d9b-8327-35bc829c0811" returned: 0 in 0.338s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-84419866-6a76-40ab-8d9e-05ab1d951447 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-0993fd4f-b1c9-4d9b-8327-35bc829c0811" released by "delete_volume" :: held 1.001s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:28 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-84419866-6a76-40ab-8d9e-05ab1d951447 tempest-GroupSnapshotsTest-1904442589 None] Created reservations ['8111291f-4ebb-489c-9958-ab6f74fe190a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:28 devstack cinder-volume[87084]: WARNING cinder.quota [None req-84419866-6a76-40ab-8d9e-05ab1d951447 tempest-GroupSnapshotsTest-1904442589 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-388296730 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-388296730, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:47:28 devstack cinder-volume[87084]: WARNING cinder.quota [None req-84419866-6a76-40ab-8d9e-05ab1d951447 tempest-GroupSnapshotsTest-1904442589 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-388296730 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-388296730, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:47:28 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_khuoq4bsdevstack@QuobyteHD" returned: 0 in 0.534s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:28 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] 918d0223-61d3-44de-a27f-c6e0b6ba1310 was qcow2, converting to qcow2 {{(pid=87084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:47:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_khuoq4bsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:28 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-84419866-6a76-40ab-8d9e-05ab1d951447 tempest-GroupSnapshotsTest-1904442589 None] Created reservations ['e9428b0d-2b8e-4cf1-937e-1d7cc1ece3d0', '6087df9b-80ee-4bad-87b0-123836d22ece', '2a254819-89c5-4698-95cf-dafdbd03b920', '19a33b16-d785-4537-acf8-b998acf20d06'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:28 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_khuoq4bsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a Nov 02 10:47:28 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3377f7ce-3215-4eac-9a08-11a6c8bd83a3 tempest-VolumesActionsTest-1313225901 None] Acquiring lock "cinder-150779b5-40c5-4c7c-bed5-f253ca9b2ce1" by "attach_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3377f7ce-3215-4eac-9a08-11a6c8bd83a3 tempest-VolumesActionsTest-1313225901 None] Lock "cinder-150779b5-40c5-4c7c-bed5-f253ca9b2ce1" acquired by "attach_volume" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-84419866-6a76-40ab-8d9e-05ab1d951447 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-84419866-6a76-40ab-8d9e-05ab1d951447 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-84419866-6a76-40ab-8d9e-05ab1d951447 tempest-GroupSnapshotsTest-1904442589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-84419866-6a76-40ab-8d9e-05ab1d951447 tempest-GroupSnapshotsTest-1904442589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-84419866-6a76-40ab-8d9e-05ab1d951447 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-84419866-6a76-40ab-8d9e-05ab1d951447 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:29 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:47:29 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3377f7ce-3215-4eac-9a08-11a6c8bd83a3 tempest-VolumesActionsTest-1313225901 None] Attaching volume 150779b5-40c5-4c7c-bed5-f253ca9b2ce1 to instance edc9db60-6438-46ea-99b9-8ab325cfd99f at mountpoint /dev/vdb on host None. Nov 02 10:47:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3377f7ce-3215-4eac-9a08-11a6c8bd83a3 tempest-VolumesActionsTest-1313225901 None] Attach volume completed successfully. Nov 02 10:47:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3377f7ce-3215-4eac-9a08-11a6c8bd83a3 tempest-VolumesActionsTest-1313225901 None] Lock "cinder-150779b5-40c5-4c7c-bed5-f253ca9b2ce1" released by "attach_volume" :: held 0.259s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:29 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-84419866-6a76-40ab-8d9e-05ab1d951447 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.344s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:29 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-84419866-6a76-40ab-8d9e-05ab1d951447 tempest-GroupSnapshotsTest-1904442589 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-84419866-6a76-40ab-8d9e-05ab1d951447 tempest-GroupSnapshotsTest-1904442589 None] Delete group completed successfully. Nov 02 10:47:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aa2a5f63-e12c-47f3-8e96-48fb5ed6299e tempest-VolumesActionsTest-1313225901 None] Acquiring lock "cinder-150779b5-40c5-4c7c-bed5-f253ca9b2ce1-detach_volume" by "detach_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aa2a5f63-e12c-47f3-8e96-48fb5ed6299e tempest-VolumesActionsTest-1313225901 None] Lock "cinder-150779b5-40c5-4c7c-bed5-f253ca9b2ce1-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-aa2a5f63-e12c-47f3-8e96-48fb5ed6299e tempest-VolumesActionsTest-1313225901 None] Detaching volume 150779b5-40c5-4c7c-bed5-f253ca9b2ce1 from instance edc9db60-6438-46ea-99b9-8ab325cfd99f. Nov 02 10:47:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-aa2a5f63-e12c-47f3-8e96-48fb5ed6299e tempest-VolumesActionsTest-1313225901 None] Detach volume completed successfully. Nov 02 10:47:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aa2a5f63-e12c-47f3-8e96-48fb5ed6299e tempest-VolumesActionsTest-1313225901 None] Lock "cinder-150779b5-40c5-4c7c-bed5-f253ca9b2ce1-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:30 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] group_snapshot 73777fb4-10ed-412c-93f2-cb251d17c9de: deleting Nov 02 10:47:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] group_snapshot 73777fb4-10ed-412c-93f2-cb251d17c9de: deleting {{(pid=87084) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:47:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "cinder-quobyte-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "cinder-quobyte-770c9a0c-d098-4ac0-80d3-52753d6b3879" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-770c9a0c-d098-4ac0-80d3-52753d6b3879" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] Deleting offline snapshot 770c9a0c-d098-4ac0-80d3-52753d6b3879 of volume e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:47:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] snapshot_file for this snap is: volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:47:30 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e58dbe7-9ed0-4429-b50e-528faf22ff6b]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:30 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879 Nov 02 10:47:30 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:31 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879" returned: 0 in 0.708s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:47:31 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[665cbc7e-5983-455a-8e03-e4e83a042e19]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:31 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf Nov 02 10:47:31 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:31 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_khuoq4bsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a" returned: 0 in 3.054s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:31 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_khuoq4bsdevstack@QuobyteHD, size 112.00 MB, duration 3.06 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:47:31 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Converted 112.00 MB image at 36.66 MB/s Nov 02 10:47:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:31 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a 1G Nov 02 10:47:31 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:31 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf" returned: 0 in 0.709s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:32 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879 Nov 02 10:47:32 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:32 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a 1G" returned: 0 in 0.493s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:32 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Downloaded image 918d0223-61d3-44de-a27f-c6e0b6ba1310 ((None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}])) to volume a87b19c8-e0a8-465b-8506-1b4123b66f6a successfully. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:47:32 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Temporary image 918d0223-61d3-44de-a27f-c6e0b6ba1310 for user 3e5f499a875d4866a250710c3ed390f4 is deleted. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:47:32 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Marking volume a87b19c8-e0a8-465b-8506-1b4123b66f6a as bootable. {{(pid=87084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:47:32 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Copying metadata from image 918d0223-61d3-44de-a27f-c6e0b6ba1310 to a87b19c8-e0a8-465b-8506-1b4123b66f6a. {{(pid=87084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:47:32 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Creating volume glance metadata for volume a87b19c8-e0a8-465b-8506-1b4123b66f6a backed by image 918d0223-61d3-44de-a27f-c6e0b6ba1310 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:47:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0022e1-75ec-48a9-97f4-3dec387a5cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a', 'volume_size': 1, 'image_id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9af457eb3c6844a99ee880354ae43eac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'created_at': datetime.datetime(2026, 11, 2, 9, 33, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0223-61d3-44de-a27f-c6e0b6ba1310/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11a3426-1eec-4d8c-a306-bdf664d21abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:32 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Volume volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a (a87b19c8-e0a8-465b-8506-1b4123b66f6a): created successfully Nov 02 10:47:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11a3426-1eec-4d8c-a306-bdf664d21abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:32 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Flow 'volume_create_manager' (fa57eaae-6947-4915-99dc-c5cf033ed594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879" returned: 0 in 0.573s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:32 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879 Nov 02 10:47:32 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:32 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-094af1a2-e1c2-4510-9c76-fda4fde0bdef tempest-VolumesGetTest-1115319392 None] Created volume successfully. Nov 02 10:47:32 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf.770c9a0c-d098-4ac0-80d3-52753d6b3879" returned: 0 in 0.277s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-770c9a0c-d098-4ac0-80d3-52753d6b3879" released by "_delete_snapshot" :: held 2.502s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf" released by "delete_snapshot" :: held 2.556s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:32 devstack cinder-volume[87084]: WARNING cinder.quota [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-388296730 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-388296730, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:47:32 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] Created reservations ['bed04422-de93-4f5f-be4e-3aaef36f3555', 'dc5efa57-c7af-4588-9254-f52e93833641', '552f5517-646b-427e-81e8-c241fe46d2be', 'c6ee9eae-d87a-4b6a-bb35-013d52b0b846'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c59a8454-6cd9-4a3d-91cc-a79b8e661838 tempest-GroupSnapshotsTest-1904442589 None] group_snapshot 73777fb4-10ed-412c-93f2-cb251d17c9de: deleted successfully Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f27d8a35-df0a-4efc-862f-ec0989695b7e tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "cinder-quobyte-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f27d8a35-df0a-4efc-862f-ec0989695b7e tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f43797c-cf9b-4cac-ad1c-99e3d3f23c4f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f27d8a35-df0a-4efc-862f-ec0989695b7e tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Flow 'volume_create_manager' (3f871768-993b-4a9b-a39f-c5e53193dfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f89bf6-30a7-4fd9-a2d5-8edc69fdbb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f89bf6-30a7-4fd9-a2d5-8edc69fdbb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-110966210',display_name='tempest-VolumesGetTest-Volume-967571269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d02136-8b1a-401e-af48-b4a78299b795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0ef435b4c94e729346b963a40ef057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:34Z,use_quota=True,user_id='3e5f499a875d4866a250710c3ed390f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936e50b0-d1e4-4c2c-82bd-10144067cf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936e50b0-d1e4-4c2c-82bd-10144067cf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a9f16a-98e5-4588-bca3-f0b93d0e27ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a9f16a-98e5-4588-bca3-f0b93d0e27ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09d02136-8b1a-401e-af48-b4a78299b795', 'volume_name': 'volume-09d02136-8b1a-401e-af48-b4a78299b795', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5702db-696d-4cd4-a096-106a5d256cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5702db-696d-4cd4-a096-106a5d256cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13fa8bc8-bda6-4d5a-89c6-44de7b010dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:34 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Volume 09d02136-8b1a-401e-af48-b4a78299b795: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09d02136-8b1a-401e-af48-b4a78299b795', 'volume_size': 1} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-110966210',display_name='tempest-VolumesGetTest-Volume-967571269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d02136-8b1a-401e-af48-b4a78299b795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0ef435b4c94e729346b963a40ef057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:34Z,use_quota=True,user_id='3e5f499a875d4866a250710c3ed390f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Creating volume 09d02136-8b1a-401e-af48-b4a78299b795 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:34 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-09d02136-8b1a-401e-af48-b4a78299b795 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:34 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf Nov 02 10:47:34 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:34 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-09d02136-8b1a-401e-af48-b4a78299b795 1073741824 Nov 02 10:47:34 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:34 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f27d8a35-df0a-4efc-862f-ec0989695b7e tempest-GroupSnapshotsTest-1904442589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf" returned: 0 in 0.477s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f27d8a35-df0a-4efc-862f-ec0989695b7e tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:34 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf Nov 02 10:47:34 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:34 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-09d02136-8b1a-401e-af48-b4a78299b795 1073741824" returned: 0 in 0.551s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-09d02136-8b1a-401e-af48-b4a78299b795 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:35 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-09d02136-8b1a-401e-af48-b4a78299b795 Nov 02 10:47:35 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:35 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f27d8a35-df0a-4efc-862f-ec0989695b7e tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf" returned: 0 in 0.334s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f27d8a35-df0a-4efc-862f-ec0989695b7e tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-e4a0b7ac-0f36-4a6c-be0e-ec8650a28abf" released by "delete_volume" :: held 0.942s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:35 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-f27d8a35-df0a-4efc-862f-ec0989695b7e tempest-GroupSnapshotsTest-1904442589 None] Created reservations ['ccdad7d3-e033-4efb-a078-2f6dd8fadc15'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:35 devstack cinder-volume[87084]: WARNING cinder.db.api [None req-f27d8a35-df0a-4efc-862f-ec0989695b7e tempest-GroupSnapshotsTest-1904442589 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-388296730'] Nov 02 10:47:35 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-f27d8a35-df0a-4efc-862f-ec0989695b7e tempest-GroupSnapshotsTest-1904442589 None] Created reservations ['5016e2bd-8390-409f-aa43-7f37fc9051c5', 'd9a6d897-1764-4fcb-91c4-6ee2dcd3691b', 'a51e1b3a-76e7-45d3-bb01-8fb60db00f3c', '8b669419-0f9e-4b3c-b55a-15b63f088009'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:35 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-09d02136-8b1a-401e-af48-b4a78299b795" returned: 0 in 0.382s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:47:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13fa8bc8-bda6-4d5a-89c6-44de7b010dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09d02136-8b1a-401e-af48-b4a78299b795', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81f1d35-5ddc-4e82-a831-cfd9ddf9221e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:35 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Volume volume-09d02136-8b1a-401e-af48-b4a78299b795 (09d02136-8b1a-401e-af48-b4a78299b795): created successfully Nov 02 10:47:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81f1d35-5ddc-4e82-a831-cfd9ddf9221e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Flow 'volume_create_manager' (3f871768-993b-4a9b-a39f-c5e53193dfce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:35 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1d75e692-68cd-475f-b835-43e4aa943f2b tempest-VolumesGetTest-1115319392 None] Created volume successfully. Nov 02 10:47:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f27d8a35-df0a-4efc-862f-ec0989695b7e tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f27d8a35-df0a-4efc-862f-ec0989695b7e tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f27d8a35-df0a-4efc-862f-ec0989695b7e tempest-GroupSnapshotsTest-1904442589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f27d8a35-df0a-4efc-862f-ec0989695b7e tempest-GroupSnapshotsTest-1904442589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f27d8a35-df0a-4efc-862f-ec0989695b7e tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f27d8a35-df0a-4efc-862f-ec0989695b7e tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:35 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:47:35 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:35 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f27d8a35-df0a-4efc-862f-ec0989695b7e tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.321s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:35 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-f27d8a35-df0a-4efc-862f-ec0989695b7e tempest-GroupSnapshotsTest-1904442589 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:35 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f27d8a35-df0a-4efc-862f-ec0989695b7e tempest-GroupSnapshotsTest-1904442589 None] Delete group completed successfully. Nov 02 10:47:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-30681178-9d6f-4776-8dad-03d80ee00eae tempest-VolumesGetTest-1115319392 None] Acquiring lock "cinder-09d02136-8b1a-401e-af48-b4a78299b795-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-30681178-9d6f-4776-8dad-03d80ee00eae tempest-VolumesGetTest-1115319392 None] Lock "cinder-09d02136-8b1a-401e-af48-b4a78299b795-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-30681178-9d6f-4776-8dad-03d80ee00eae tempest-VolumesGetTest-1115319392 None] Acquiring lock "cinder-quobyte-09d02136-8b1a-401e-af48-b4a78299b795" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-30681178-9d6f-4776-8dad-03d80ee00eae tempest-VolumesGetTest-1115319392 None] Lock "cinder-quobyte-09d02136-8b1a-401e-af48-b4a78299b795" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:36 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[940c3d86-740c-4f8b-96f0-f3f4c9c69a87]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30681178-9d6f-4776-8dad-03d80ee00eae tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-09d02136-8b1a-401e-af48-b4a78299b795 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:37 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-09d02136-8b1a-401e-af48-b4a78299b795 Nov 02 10:47:37 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-42d9a9a5-8355-4238-899e-423932cbd63e tempest-GroupSnapshotsTest-1904442589 None] Group tempest-GroupSnapshotsTest-Group-1646799801: creating Nov 02 10:47:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-42d9a9a5-8355-4238-899e-423932cbd63e tempest-GroupSnapshotsTest-1904442589 None] Group tempest-GroupSnapshotsTest-Group-1646799801: created successfully Nov 02 10:47:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-42d9a9a5-8355-4238-899e-423932cbd63e tempest-GroupSnapshotsTest-1904442589 None] Create group completed successfully. Nov 02 10:47:37 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30681178-9d6f-4776-8dad-03d80ee00eae tempest-VolumesGetTest-1115319392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-09d02136-8b1a-401e-af48-b4a78299b795" returned: 0 in 0.490s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30681178-9d6f-4776-8dad-03d80ee00eae tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-09d02136-8b1a-401e-af48-b4a78299b795 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:37 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-09d02136-8b1a-401e-af48-b4a78299b795 Nov 02 10:47:37 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:37 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30681178-9d6f-4776-8dad-03d80ee00eae tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-09d02136-8b1a-401e-af48-b4a78299b795" returned: 0 in 0.298s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-30681178-9d6f-4776-8dad-03d80ee00eae tempest-VolumesGetTest-1115319392 None] Lock "cinder-quobyte-09d02136-8b1a-401e-af48-b4a78299b795" released by "delete_volume" :: held 0.859s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:37 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-30681178-9d6f-4776-8dad-03d80ee00eae tempest-VolumesGetTest-1115319392 None] Created reservations ['c97dd3e5-6c8c-4c3f-b43d-b6a526aa9759', '1d44709a-4b54-495f-b299-35963196e022', '2027b13f-d942-427f-aabc-f90f429d93be', 'de866271-b5cd-442e-975d-37322591830e'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-30681178-9d6f-4776-8dad-03d80ee00eae tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-30681178-9d6f-4776-8dad-03d80ee00eae tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-30681178-9d6f-4776-8dad-03d80ee00eae tempest-VolumesGetTest-1115319392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-30681178-9d6f-4776-8dad-03d80ee00eae tempest-VolumesGetTest-1115319392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-30681178-9d6f-4776-8dad-03d80ee00eae tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30681178-9d6f-4776-8dad-03d80ee00eae tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:37 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:47:37 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:38 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30681178-9d6f-4776-8dad-03d80ee00eae tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.326s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:38 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-30681178-9d6f-4776-8dad-03d80ee00eae tempest-VolumesGetTest-1115319392 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:38 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-30681178-9d6f-4776-8dad-03d80ee00eae tempest-VolumesGetTest-1115319392 None] Deleted volume successfully. Nov 02 10:47:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-30681178-9d6f-4776-8dad-03d80ee00eae tempest-VolumesGetTest-1115319392 None] Lock "cinder-09d02136-8b1a-401e-af48-b4a78299b795-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:38 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:47:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Flow 'volume_create_manager' (ddc3e8fa-dd1f-453d-8026-3c6775d63075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd16e90-721a-4293-b97d-6fd3cf683a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd16e90-721a-4293-b97d-6fd3cf683a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-238080143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4afaeb95-e410-43a3-979c-1893a37a28a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cbe2b22f45d42c3be3d74a47b26e5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:39Z,use_quota=True,user_id='2a4a98b813bf4d30b1597beb0732386f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcbb7c9-a34a-42ff-a673-82b643e406ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcbb7c9-a34a-42ff-a673-82b643e406ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea210783-c5f0-46d9-b40d-8eed7f476b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea210783-c5f0-46d9-b40d-8eed7f476b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4afaeb95-e410-43a3-979c-1893a37a28a2', 'volume_name': 'volume-4afaeb95-e410-43a3-979c-1893a37a28a2', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a9c6d3-bcd3-405f-a1ae-6607dfac2128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a9c6d3-bcd3-405f-a1ae-6607dfac2128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da464e90-d1a7-4a87-8097-357513359c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Volume 4afaeb95-e410-43a3-979c-1893a37a28a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4afaeb95-e410-43a3-979c-1893a37a28a2', 'volume_size': 1} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-238080143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4afaeb95-e410-43a3-979c-1893a37a28a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cbe2b22f45d42c3be3d74a47b26e5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:39Z,use_quota=True,user_id='2a4a98b813bf4d30b1597beb0732386f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Creating volume 4afaeb95-e410-43a3-979c-1893a37a28a2 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:39 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4afaeb95-e410-43a3-979c-1893a37a28a2 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:39 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4afaeb95-e410-43a3-979c-1893a37a28a2 1073741824 Nov 02 10:47:39 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-56d4b2d3-8a48-4fb7-b837-42c845ede8e4 tempest-VolumesGetTest-1115319392 None] Acquiring lock "cinder-a87b19c8-e0a8-465b-8506-1b4123b66f6a-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-56d4b2d3-8a48-4fb7-b837-42c845ede8e4 tempest-VolumesGetTest-1115319392 None] Lock "cinder-a87b19c8-e0a8-465b-8506-1b4123b66f6a-delete_volume" acquired by "delete_volume" :: waited 0.149s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Flow 'volume_create_manager' (ae960084-c859-463f-86e9-ba4bd0e88554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f82a10-005a-4541-b395-66f06fbcba98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f82a10-005a-4541-b395-66f06fbcba98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-958965071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3aefc6f0-f8e6-4618-9c09-4035c82f78c3,host='devstack@QuobyteHD#QuobyteHD',id=c53a3255-c8c7-4a40-acd7-10f82f0b4838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f562055a548049e7bcf745ed39e55969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:39Z,use_quota=True,user_id='86d438cf9cc042dc995c288b2c62d4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b20b44-6395-44b4-995e-d5dd82362baf),volume_type_id=20b20b44-6395-44b4-995e-d5dd82362baf)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8987ef2-3d3b-45da-8047-a607cb649a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8987ef2-3d3b-45da-8047-a607cb649a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be46dbc3-8107-4617-a334-e9c679b90765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be46dbc3-8107-4617-a334-e9c679b90765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c53a3255-c8c7-4a40-acd7-10f82f0b4838', 'volume_name': 'volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c65883b-11ce-487a-a19f-28f3dec8454b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c65883b-11ce-487a-a19f-28f3dec8454b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d61b195-ae8f-4d6a-8686-ec580ae211ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Volume c53a3255-c8c7-4a40-acd7-10f82f0b4838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838', 'volume_size': 1} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-56d4b2d3-8a48-4fb7-b837-42c845ede8e4 tempest-VolumesGetTest-1115319392 None] Acquiring lock "cinder-quobyte-a87b19c8-e0a8-465b-8506-1b4123b66f6a" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-56d4b2d3-8a48-4fb7-b837-42c845ede8e4 tempest-VolumesGetTest-1115319392 None] Lock "cinder-quobyte-a87b19c8-e0a8-465b-8506-1b4123b66f6a" acquired by "delete_volume" :: waited 0.038s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[909c5506-fd12-4bbe-a282-5fa9cf884d57]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-56d4b2d3-8a48-4fb7-b837-42c845ede8e4 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:40 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a Nov 02 10:47:40 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:40 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4afaeb95-e410-43a3-979c-1893a37a28a2 1073741824" returned: 0 in 1.044s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4afaeb95-e410-43a3-979c-1893a37a28a2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:40 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4afaeb95-e410-43a3-979c-1893a37a28a2 Nov 02 10:47:40 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:40 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-56d4b2d3-8a48-4fb7-b837-42c845ede8e4 tempest-VolumesGetTest-1115319392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a" returned: 0 in 0.629s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-56d4b2d3-8a48-4fb7-b837-42c845ede8e4 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:40 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a Nov 02 10:47:40 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:40 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4afaeb95-e410-43a3-979c-1893a37a28a2" returned: 0 in 0.301s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.838s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3aefc6f0-f8e6-4618-9c09-4035c82f78c3,created_at=2026-11-02T09:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-958965071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3aefc6f0-f8e6-4618-9c09-4035c82f78c3,host='devstack@QuobyteHD#QuobyteHD',id=c53a3255-c8c7-4a40-acd7-10f82f0b4838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f562055a548049e7bcf745ed39e55969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:39Z,use_quota=True,user_id='86d438cf9cc042dc995c288b2c62d4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b20b44-6395-44b4-995e-d5dd82362baf),volume_type_id=20b20b44-6395-44b4-995e-d5dd82362baf)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Creating volume c53a3255-c8c7-4a40-acd7-10f82f0b4838 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:40 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da464e90-d1a7-4a87-8097-357513359c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4afaeb95-e410-43a3-979c-1893a37a28a2', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c934a10a-532e-423e-a238-b8e5f44daf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:40 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838 1073741824 Nov 02 10:47:40 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:40 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Volume volume-4afaeb95-e410-43a3-979c-1893a37a28a2 (4afaeb95-e410-43a3-979c-1893a37a28a2): created successfully Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c934a10a-532e-423e-a238-b8e5f44daf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Flow 'volume_create_manager' (ddc3e8fa-dd1f-453d-8026-3c6775d63075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:40 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-39b62bef-6986-4d66-b884-4bda8214f2cc tempest-VolumesServicesTestJSON-1860230285 None] Created volume successfully. Nov 02 10:47:40 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-56d4b2d3-8a48-4fb7-b837-42c845ede8e4 tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a87b19c8-e0a8-465b-8506-1b4123b66f6a" returned: 0 in 0.484s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-56d4b2d3-8a48-4fb7-b837-42c845ede8e4 tempest-VolumesGetTest-1115319392 None] Lock "cinder-quobyte-a87b19c8-e0a8-465b-8506-1b4123b66f6a" released by "delete_volume" :: held 1.229s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-56d4b2d3-8a48-4fb7-b837-42c845ede8e4 tempest-VolumesGetTest-1115319392 None] Created reservations ['fbb42bdc-c640-4faf-a18d-0594609a14d9', 'f9a61176-bd8a-4689-a470-4bc98fc13f06', 'a9dc222a-485e-45de-8fc9-3ba639703dbf', '873a525c-6761-46f4-9e8c-108e8c5c6b27'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-56d4b2d3-8a48-4fb7-b837-42c845ede8e4 tempest-VolumesGetTest-1115319392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-56d4b2d3-8a48-4fb7-b837-42c845ede8e4 tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-56d4b2d3-8a48-4fb7-b837-42c845ede8e4 tempest-VolumesGetTest-1115319392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-56d4b2d3-8a48-4fb7-b837-42c845ede8e4 tempest-VolumesGetTest-1115319392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-56d4b2d3-8a48-4fb7-b837-42c845ede8e4 tempest-VolumesGetTest-1115319392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-56d4b2d3-8a48-4fb7-b837-42c845ede8e4 tempest-VolumesGetTest-1115319392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:41 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:47:41 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:41 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838 1073741824" returned: 0 in 0.840s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2f44b713-b145-4ba2-9fde-8546b10b43cb tempest-VolumesServicesTestJSON-1860230285 None] Acquiring lock "cinder-4afaeb95-e410-43a3-979c-1893a37a28a2-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2f44b713-b145-4ba2-9fde-8546b10b43cb tempest-VolumesServicesTestJSON-1860230285 None] Lock "cinder-4afaeb95-e410-43a3-979c-1893a37a28a2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:41 devstack sudo[96742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838 Nov 02 10:47:41 devstack sudo[96742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:41 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-56d4b2d3-8a48-4fb7-b837-42c845ede8e4 tempest-VolumesGetTest-1115319392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.332s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-56d4b2d3-8a48-4fb7-b837-42c845ede8e4 tempest-VolumesGetTest-1115319392 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-56d4b2d3-8a48-4fb7-b837-42c845ede8e4 tempest-VolumesGetTest-1115319392 None] Deleted volume successfully. Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2f44b713-b145-4ba2-9fde-8546b10b43cb tempest-VolumesServicesTestJSON-1860230285 None] Acquiring lock "cinder-quobyte-4afaeb95-e410-43a3-979c-1893a37a28a2" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2f44b713-b145-4ba2-9fde-8546b10b43cb tempest-VolumesServicesTestJSON-1860230285 None] Lock "cinder-quobyte-4afaeb95-e410-43a3-979c-1893a37a28a2" acquired by "delete_volume" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-56d4b2d3-8a48-4fb7-b837-42c845ede8e4 tempest-VolumesGetTest-1115319392 None] Lock "cinder-a87b19c8-e0a8-465b-8506-1b4123b66f6a-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bac38c-75dd-4908-ae49-21c8b6a8f9c5]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2f44b713-b145-4ba2-9fde-8546b10b43cb tempest-VolumesServicesTestJSON-1860230285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4afaeb95-e410-43a3-979c-1893a37a28a2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:41 devstack sudo[96742]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838" returned: 0 in 0.390s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:41 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4afaeb95-e410-43a3-979c-1893a37a28a2 Nov 02 10:47:41 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d61b195-ae8f-4d6a-8686-ec580ae211ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afb80f5-a856-4831-a919-c1c22f478f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Volume volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838 (c53a3255-c8c7-4a40-acd7-10f82f0b4838): created successfully Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afb80f5-a856-4831-a919-c1c22f478f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Flow 'volume_create_manager' (ae960084-c859-463f-86e9-ba4bd0e88554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d1cf6e80-4c06-4408-822b-b7a218644390 tempest-GroupSnapshotsTest-1904442589 None] Created volume successfully. Nov 02 10:47:42 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2f44b713-b145-4ba2-9fde-8546b10b43cb tempest-VolumesServicesTestJSON-1860230285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4afaeb95-e410-43a3-979c-1893a37a28a2" returned: 0 in 0.508s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2f44b713-b145-4ba2-9fde-8546b10b43cb tempest-VolumesServicesTestJSON-1860230285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4afaeb95-e410-43a3-979c-1893a37a28a2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:42 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4afaeb95-e410-43a3-979c-1893a37a28a2 Nov 02 10:47:42 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:42 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2f44b713-b145-4ba2-9fde-8546b10b43cb tempest-VolumesServicesTestJSON-1860230285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4afaeb95-e410-43a3-979c-1893a37a28a2" returned: 0 in 0.452s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2f44b713-b145-4ba2-9fde-8546b10b43cb tempest-VolumesServicesTestJSON-1860230285 None] Lock "cinder-quobyte-4afaeb95-e410-43a3-979c-1893a37a28a2" released by "delete_volume" :: held 1.056s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:42 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-2f44b713-b145-4ba2-9fde-8546b10b43cb tempest-VolumesServicesTestJSON-1860230285 None] Created reservations ['ae5d11bf-5d61-476b-a903-13484dd1dc14', '48025604-a17e-498e-827f-1109b719d730', 'dff83ff0-0c8e-4f47-9493-8c6527e335b0', '478a18dd-0246-4f44-99b0-0bfaec6b24b6'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2f44b713-b145-4ba2-9fde-8546b10b43cb tempest-VolumesServicesTestJSON-1860230285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2f44b713-b145-4ba2-9fde-8546b10b43cb tempest-VolumesServicesTestJSON-1860230285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2f44b713-b145-4ba2-9fde-8546b10b43cb tempest-VolumesServicesTestJSON-1860230285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2f44b713-b145-4ba2-9fde-8546b10b43cb tempest-VolumesServicesTestJSON-1860230285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2f44b713-b145-4ba2-9fde-8546b10b43cb tempest-VolumesServicesTestJSON-1860230285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2f44b713-b145-4ba2-9fde-8546b10b43cb tempest-VolumesServicesTestJSON-1860230285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:42 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:47:42 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-96fa0370-5c64-4528-8f68-f9897b7642c8 tempest-VolumesActionsTest-1313225901 None] Acquiring lock "cinder-150779b5-40c5-4c7c-bed5-f253ca9b2ce1" by "attach_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-96fa0370-5c64-4528-8f68-f9897b7642c8 tempest-VolumesActionsTest-1313225901 None] Lock "cinder-150779b5-40c5-4c7c-bed5-f253ca9b2ce1" acquired by "attach_volume" :: waited 0.039s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:43 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2f44b713-b145-4ba2-9fde-8546b10b43cb tempest-VolumesServicesTestJSON-1860230285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.532s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-2f44b713-b145-4ba2-9fde-8546b10b43cb tempest-VolumesServicesTestJSON-1860230285 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Flow 'volume_create_manager' (3060101c-d9eb-4ae6-b353-5fa6b5f5a47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef21ae6d-ff69-47ab-9fd6-8e800e54e547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2f44b713-b145-4ba2-9fde-8546b10b43cb tempest-VolumesServicesTestJSON-1860230285 None] Deleted volume successfully. Nov 02 10:47:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-96fa0370-5c64-4528-8f68-f9897b7642c8 tempest-VolumesActionsTest-1313225901 None] Attaching volume 150779b5-40c5-4c7c-bed5-f253ca9b2ce1 to instance f0b658dd-6b37-4eb1-ad26-34c45a8f195e at mountpoint /dev/vdb on host None. Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef21ae6d-ff69-47ab-9fd6-8e800e54e547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-28243745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3aefc6f0-f8e6-4618-9c09-4035c82f78c3,host='devstack@QuobyteHD#QuobyteHD',id=ede68d61-dd37-4452-9bd5-6519e2cd3c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f562055a548049e7bcf745ed39e55969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:43Z,use_quota=True,user_id='86d438cf9cc042dc995c288b2c62d4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b20b44-6395-44b4-995e-d5dd82362baf),volume_type_id=20b20b44-6395-44b4-995e-d5dd82362baf)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efcaba73-cd54-42ef-acc0-4bded1ba8229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efcaba73-cd54-42ef-acc0-4bded1ba8229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (525e770e-d505-4dde-9caf-6b4a6e69c57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (525e770e-d505-4dde-9caf-6b4a6e69c57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ede68d61-dd37-4452-9bd5-6519e2cd3c84', 'volume_name': 'volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0da1d2-45fd-452d-b758-a832a848ea7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0da1d2-45fd-452d-b758-a832a848ea7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3335463-0415-4089-a7ed-4942f58981c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:43 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Volume ede68d61-dd37-4452-9bd5-6519e2cd3c84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84', 'volume_size': 1} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3aefc6f0-f8e6-4618-9c09-4035c82f78c3,created_at=2026-11-02T09:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-28243745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3aefc6f0-f8e6-4618-9c09-4035c82f78c3,host='devstack@QuobyteHD#QuobyteHD',id=ede68d61-dd37-4452-9bd5-6519e2cd3c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f562055a548049e7bcf745ed39e55969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:43Z,use_quota=True,user_id='86d438cf9cc042dc995c288b2c62d4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20b20b44-6395-44b4-995e-d5dd82362baf),volume_type_id=20b20b44-6395-44b4-995e-d5dd82362baf)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Creating volume ede68d61-dd37-4452-9bd5-6519e2cd3c84 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:43 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-96fa0370-5c64-4528-8f68-f9897b7642c8 tempest-VolumesActionsTest-1313225901 None] Attach volume completed successfully. Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2f44b713-b145-4ba2-9fde-8546b10b43cb tempest-VolumesServicesTestJSON-1860230285 None] Lock "cinder-4afaeb95-e410-43a3-979c-1893a37a28a2-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-96fa0370-5c64-4528-8f68-f9897b7642c8 tempest-VolumesActionsTest-1313225901 None] Lock "cinder-150779b5-40c5-4c7c-bed5-f253ca9b2ce1" released by "attach_volume" :: held 0.423s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:43 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84 1073741824 Nov 02 10:47:43 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:44 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84 1073741824" returned: 0 in 0.653s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:44 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84 Nov 02 10:47:44 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-88b1018a-0013-47b1-a25d-d736b72fed88 tempest-VolumesActionsTest-1313225901 None] Acquiring lock "cinder-150779b5-40c5-4c7c-bed5-f253ca9b2ce1-detach_volume" by "detach_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-88b1018a-0013-47b1-a25d-d736b72fed88 tempest-VolumesActionsTest-1313225901 None] Lock "cinder-150779b5-40c5-4c7c-bed5-f253ca9b2ce1-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-88b1018a-0013-47b1-a25d-d736b72fed88 tempest-VolumesActionsTest-1313225901 None] Detaching volume 150779b5-40c5-4c7c-bed5-f253ca9b2ce1 from instance f0b658dd-6b37-4eb1-ad26-34c45a8f195e. Nov 02 10:47:44 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84" returned: 0 in 0.419s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-88b1018a-0013-47b1-a25d-d736b72fed88 tempest-VolumesActionsTest-1313225901 None] Detach volume completed successfully. Nov 02 10:47:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:47:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-88b1018a-0013-47b1-a25d-d736b72fed88 tempest-VolumesActionsTest-1313225901 None] Lock "cinder-150779b5-40c5-4c7c-bed5-f253ca9b2ce1-detach_volume" released by "detach_volume" :: held 0.161s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3335463-0415-4089-a7ed-4942f58981c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b7adcb-cd36-4db9-be3e-b807482becbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:44 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Volume volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84 (ede68d61-dd37-4452-9bd5-6519e2cd3c84): created successfully Nov 02 10:47:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b7adcb-cd36-4db9-be3e-b807482becbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Flow 'volume_create_manager' (3060101c-d9eb-4ae6-b353-5fa6b5f5a47a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9f275a61-522e-404c-9a07-e99e362781c8 tempest-GroupSnapshotsTest-1904442589 None] Created volume successfully. Nov 02 10:47:46 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c8024998-f6bc-41a0-8b14-d5841cf7eb80 tempest-GroupSnapshotsTest-1904442589 None] Update group completed successfully. Nov 02 10:47:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5ebf6111-4116-46be-978d-3f7a73cc2b01 tempest-GroupSnapshotsTest-1904442589 None] Update group completed successfully. Nov 02 10:47:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-bd7f2868-657f-4118-94dd-0cdb0fea8467 tempest-GroupSnapshotsTest-1904442589 None] Update group completed successfully. Nov 02 10:47:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5deda20c-c2ae-4985-a3d1-990e0a5ae935 tempest-GroupSnapshotsTest-1904442589 None] Update group completed successfully. Nov 02 10:47:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4df37fbe-0910-4f81-8b89-d2c7b579de47 tempest-VolumesActionsTest-1313225901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4df37fbe-0910-4f81-8b89-d2c7b579de47 tempest-VolumesActionsTest-1313225901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:50 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a02748-6359-4a33-8061-f8db2e1e6c2d]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4df37fbe-0910-4f81-8b89-d2c7b579de47 tempest-VolumesActionsTest-1313225901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:50 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 Nov 02 10:47:50 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:50 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4df37fbe-0910-4f81-8b89-d2c7b579de47 tempest-VolumesActionsTest-1313225901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1" returned: 0 in 0.437s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:50 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8972063-4f75-4bc0-bd5f-0970c9c5c31d]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4df37fbe-0910-4f81-8b89-d2c7b579de47 tempest-VolumesActionsTest-1313225901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:50 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 Nov 02 10:47:50 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:50 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4df37fbe-0910-4f81-8b89-d2c7b579de47 tempest-VolumesActionsTest-1313225901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1" returned: 0 in 0.435s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4df37fbe-0910-4f81-8b89-d2c7b579de47 tempest-VolumesActionsTest-1313225901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 /opt/stack/data/cinder/conversion/150779b5-40c5-4c7c-bed5-f253ca9b2ce1.temp_image.cce1e2fc-756e-43d2-a982-10a154c783e9vthes8i7.img {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:50 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 /opt/stack/data/cinder/conversion/150779b5-40c5-4c7c-bed5-f253ca9b2ce1.temp_image.cce1e2fc-756e-43d2-a982-10a154c783e9vthes8i7.img Nov 02 10:47:50 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:51 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] GroupSnapshot 2f254cff-5d1d-416e-93e6-53ee686de3fb: creating. Nov 02 10:47:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Group snapshot 2f254cff-5d1d-416e-93e6-53ee686de3fb: creating. {{(pid=87084) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:47:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:52 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:47:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Flow 'volume_create_manager' (98e6ffc2-361c-4e13-9359-f83bc7d6a67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e094e90b-a3d4-4c7e-b762-652f44d6c8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e094e90b-a3d4-4c7e-b762-652f44d6c8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1477713182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6315f3d4-495a-44f8-8383-7ab35b44d915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8cc75013b7b4744ba25131600d3ac39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:53Z,use_quota=True,user_id='e6701669955b439fa9fedb5e2f760712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd93453f-42cd-4b26-afa3-3838b8184d42),volume_type_id=cd93453f-42cd-4b26-afa3-3838b8184d42)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef1d0c3-cfa4-4ca3-9973-4fdb4d9e5f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef1d0c3-cfa4-4ca3-9973-4fdb4d9e5f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa0551a-0d22-4aba-8e73-12bdd6ec9226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa0551a-0d22-4aba-8e73-12bdd6ec9226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6315f3d4-495a-44f8-8383-7ab35b44d915', 'volume_name': 'volume-6315f3d4-495a-44f8-8383-7ab35b44d915', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5fc5bb-2bb7-46d2-80a1-0d24910d88b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5fc5bb-2bb7-46d2-80a1-0d24910d88b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab430fba-8e63-4a45-a69d-3e2649f7e820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:53 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Volume 6315f3d4-495a-44f8-8383-7ab35b44d915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6315f3d4-495a-44f8-8383-7ab35b44d915', 'volume_size': 1} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:53 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:47:53 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:53 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.418s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:47:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:47:58 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4df37fbe-0910-4f81-8b89-d2c7b579de47 tempest-VolumesActionsTest-1313225901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 /opt/stack/data/cinder/conversion/150779b5-40c5-4c7c-bed5-f253ca9b2ce1.temp_image.cce1e2fc-756e-43d2-a982-10a154c783e9vthes8i7.img" returned: 0 in 7.415s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:58 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbb5453-a84b-448e-a73b-38352b76cfe8]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4df37fbe-0910-4f81-8b89-d2c7b579de47 tempest-VolumesActionsTest-1313225901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:58 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 Nov 02 10:47:58 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:58 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4df37fbe-0910-4f81-8b89-d2c7b579de47 tempest-VolumesActionsTest-1313225901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1" returned: 0 in 0.552s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:58 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-4df37fbe-0910-4f81-8b89-d2c7b579de47 tempest-VolumesActionsTest-1313225901 None] Image conversion details: src /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1, size 1024.00 MB, duration 7.42 sec, destination /opt/stack/data/cinder/conversion/150779b5-40c5-4c7c-bed5-f253ca9b2ce1.temp_image.cce1e2fc-756e-43d2-a982-10a154c783e9vthes8i7.img {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:47:58 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-4df37fbe-0910-4f81-8b89-d2c7b579de47 tempest-VolumesActionsTest-1313225901 None] Converted 1024.00 MB image at 138.07 MB/s Nov 02 10:47:58 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-4df37fbe-0910-4f81-8b89-d2c7b579de47 tempest-VolumesActionsTest-1313225901 None] cce1e2fc-756e-43d2-a982-10a154c783e9 was raw, no need to convert to raw {{(pid=87084) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 10:48:03 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:INSERT=22,cinder:UPDATE=93,cinder:SELECT=71,cinder:DELETE=5 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:48:04 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:48:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Flow 'volume_create_manager' (91b85316-b981-41d4-b9d6-69738a01b27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9162abb-74d5-4c72-b2cc-f0ff55544ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9162abb-74d5-4c72-b2cc-f0ff55544ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-371780099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf4085ca-6ca7-46d2-b9e8-637359adaed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169ccc547bf64525ae2a8f2f0943407f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:04Z,use_quota=True,user_id='347d5bcf8db94613a831bb8af5a413c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7decfe76-005e-46a9-9bf6-72dc307144ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7decfe76-005e-46a9-9bf6-72dc307144ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32166136-1c3d-452b-bece-c992e6612550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32166136-1c3d-452b-bece-c992e6612550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf4085ca-6ca7-46d2-b9e8-637359adaed1', 'volume_name': 'volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef77d668-ad39-43b8-acc1-128cbb2df7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef77d668-ad39-43b8-acc1-128cbb2df7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c7779c-9551-4274-a8f9-ae5c744e820b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:04 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Volume bf4085ca-6ca7-46d2-b9e8-637359adaed1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1', 'volume_size': 1} Nov 02 10:48:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:14 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:48:14 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=97,cinder:INSERT=27,cinder:UPDATE=70,cinder:DELETE=3 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:48:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4df37fbe-0910-4f81-8b89-d2c7b579de47 tempest-VolumesActionsTest-1313225901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.568s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4df37fbe-0910-4f81-8b89-d2c7b579de47 tempest-VolumesActionsTest-1313225901 None] Uploaded volume to glance image-id: cce1e2fc-756e-43d2-a982-10a154c783e9. {{(pid=87084) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 10:48:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 25.916s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Creating offline snapshot 15b1c56c-f4eb-4fd7-94dc-374b43bbffb6 of volume ede68d61-dd37-4452-9bd5-6519e2cd3c84 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:48:17 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4df37fbe-0910-4f81-8b89-d2c7b579de47 tempest-VolumesActionsTest-1313225901 None] Copy volume to image completed successfully. Nov 02 10:48:17 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b195c05-97de-4bf6-afc4-54dfd5ba32dd]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:17 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84 Nov 02 10:48:17 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:18 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84" returned: 0 in 0.401s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.15b1c56c-f4eb-4fd7-94dc-374b43bbffb6 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:18 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.15b1c56c-f4eb-4fd7-94dc-374b43bbffb6 1G Nov 02 10:48:18 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:18 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.15b1c56c-f4eb-4fd7-94dc-374b43bbffb6 1G" returned: 0 in 0.477s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.15b1c56c-f4eb-4fd7-94dc-374b43bbffb6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:18 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.15b1c56c-f4eb-4fd7-94dc-374b43bbffb6 Nov 02 10:48:18 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:18 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.15b1c56c-f4eb-4fd7-94dc-374b43bbffb6" returned: 0 in 0.309s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:18 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.15b1c56c-f4eb-4fd7-94dc-374b43bbffb6 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:48:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.15b1c56c-f4eb-4fd7-94dc-374b43bbffb6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:18 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.15b1c56c-f4eb-4fd7-94dc-374b43bbffb6 Nov 02 10:48:18 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:19 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.15b1c56c-f4eb-4fd7-94dc-374b43bbffb6" returned: 0 in 0.276s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:19 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.info Nov 02 10:48:19 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:19 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.info" returned: 0 in 0.252s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:19 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:48:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:19 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.info Nov 02 10:48:19 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:19 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.info" returned: 0 in 0.236s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Creating offline snapshot f795539e-cd08-4b5e-9798-a5eecb77a5ab of volume c53a3255-c8c7-4a40-acd7-10f82f0b4838 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:48:19 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0328d9ee-9310-4b13-bc9d-12d3eaa5281c]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:19 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838 Nov 02 10:48:19 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:20 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838" returned: 0 in 0.366s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.f795539e-cd08-4b5e-9798-a5eecb77a5ab 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:20 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.f795539e-cd08-4b5e-9798-a5eecb77a5ab 1G Nov 02 10:48:20 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:20 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:20 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.f795539e-cd08-4b5e-9798-a5eecb77a5ab Nov 02 10:48:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.f795539e-cd08-4b5e-9798-a5eecb77a5ab 1G" returned: 0 in 0.401s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.f795539e-cd08-4b5e-9798-a5eecb77a5ab {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:20 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:20 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.f795539e-cd08-4b5e-9798-a5eecb77a5ab" returned: 0 in 0.283s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:20 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.f795539e-cd08-4b5e-9798-a5eecb77a5ab is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:48:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.f795539e-cd08-4b5e-9798-a5eecb77a5ab {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:20 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.f795539e-cd08-4b5e-9798-a5eecb77a5ab Nov 02 10:48:20 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:20 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.f795539e-cd08-4b5e-9798-a5eecb77a5ab" returned: 0 in 0.237s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:21 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.info Nov 02 10:48:21 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:21 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.info" returned: 0 in 0.250s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:21 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:48:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:21 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.info Nov 02 10:48:21 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:21 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.info" returned: 0 in 0.262s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.887s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.214s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-371780099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf4085ca-6ca7-46d2-b9e8-637359adaed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169ccc547bf64525ae2a8f2f0943407f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:04Z,use_quota=True,user_id='347d5bcf8db94613a831bb8af5a413c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:48:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Creating volume bf4085ca-6ca7-46d2-b9e8-637359adaed1 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:48:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:48:21 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:48:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:21 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1 1073741824 Nov 02 10:48:21 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:21 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a2d1aedf-7662-4d9b-b9ee-bc6af5ebe0c9 tempest-GroupSnapshotsTest-1904442589 None] group_snapshot 2f254cff-5d1d-416e-93e6-53ee686de3fb: created successfully Nov 02 10:48:21 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1 1073741824" returned: 0 in 0.407s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:22 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1 Nov 02 10:48:22 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:22 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] group_snapshot 2f254cff-5d1d-416e-93e6-53ee686de3fb: deleting Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] group_snapshot 2f254cff-5d1d-416e-93e6-53ee686de3fb: deleting {{(pid=87084) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:48:22 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1" returned: 0 in 0.288s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.187s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "cinder-quobyte-ede68d61-dd37-4452-9bd5-6519e2cd3c84" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c7779c-9551-4274-a8f9-ae5c744e820b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080a35c4-0e9b-4e7e-b6a8-113c448884ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-ede68d61-dd37-4452-9bd5-6519e2cd3c84" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "cinder-quobyte-15b1c56c-f4eb-4fd7-94dc-374b43bbffb6" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[191a6253-e02d-44a4-aa90-da20adb8d759]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:22 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Volume volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1 (bf4085ca-6ca7-46d2-b9e8-637359adaed1): created successfully Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080a35c4-0e9b-4e7e-b6a8-113c448884ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Flow 'volume_create_manager' (91b85316-b981-41d4-b9d6-69738a01b27e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-15b1c56c-f4eb-4fd7-94dc-374b43bbffb6" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Deleting offline snapshot 15b1c56c-f4eb-4fd7-94dc-374b43bbffb6 of volume ede68d61-dd37-4452-9bd5-6519e2cd3c84 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] snapshot_file for this snap is: volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.15b1c56c-f4eb-4fd7-94dc-374b43bbffb6 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:48:22 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6219fe0f-3149-4a9e-838a-1776fcdaa2a5 tempest-VolumesSnapshotTestJSON-1799736696 None] Created volume successfully. Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e1e023-1f01-43ae-8bb7-3f44285d6409]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.15b1c56c-f4eb-4fd7-94dc-374b43bbffb6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:22 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 Nov 02 10:48:22 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:22 devstack sudo[96898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.15b1c56c-f4eb-4fd7-94dc-374b43bbffb6 Nov 02 10:48:22 devstack sudo[96898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:22 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1" returned: 0 in 0.391s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd92aef-5c0e-4b8e-ab36-eea7bb9e0698]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:22 devstack sudo[96898]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.15b1c56c-f4eb-4fd7-94dc-374b43bbffb6" returned: 0 in 0.361s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[673b157e-00b5-47ce-b6a8-5e3963816984]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:22 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 Nov 02 10:48:22 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:22 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84 Nov 02 10:48:22 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:23 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1" returned: 0 in 0.367s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 /opt/stack/data/cinder/conversion/150779b5-40c5-4c7c-bed5-f253ca9b2ce1.temp_image.836b94b6-78c4-4f3d-b646-9aaa3152dd6dtmezsj1y.img {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:23 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 /opt/stack/data/cinder/conversion/150779b5-40c5-4c7c-bed5-f253ca9b2ce1.temp_image.836b94b6-78c4-4f3d-b646-9aaa3152dd6dtmezsj1y.img Nov 02 10:48:23 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:23 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84" returned: 0 in 0.357s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.15b1c56c-f4eb-4fd7-94dc-374b43bbffb6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:23 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.15b1c56c-f4eb-4fd7-94dc-374b43bbffb6 Nov 02 10:48:23 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:23 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.15b1c56c-f4eb-4fd7-94dc-374b43bbffb6" returned: 0 in 0.523s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.15b1c56c-f4eb-4fd7-94dc-374b43bbffb6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:23 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.15b1c56c-f4eb-4fd7-94dc-374b43bbffb6 Nov 02 10:48:23 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-47169b95-02d2-4f59-b919-dc518ba634be tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:24 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84.15b1c56c-f4eb-4fd7-94dc-374b43bbffb6" returned: 0 in 0.428s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-15b1c56c-f4eb-4fd7-94dc-374b43bbffb6" released by "_delete_snapshot" :: held 1.813s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-ede68d61-dd37-4452-9bd5-6519e2cd3c84" released by "delete_snapshot" :: held 1.868s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "cinder-quobyte-c53a3255-c8c7-4a40-acd7-10f82f0b4838" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-c53a3255-c8c7-4a40-acd7-10f82f0b4838" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "cinder-quobyte-f795539e-cd08-4b5e-9798-a5eecb77a5ab" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-f795539e-cd08-4b5e-9798-a5eecb77a5ab" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Deleting offline snapshot f795539e-cd08-4b5e-9798-a5eecb77a5ab of volume c53a3255-c8c7-4a40-acd7-10f82f0b4838 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:48:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] snapshot_file for this snap is: volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.f795539e-cd08-4b5e-9798-a5eecb77a5ab {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:48:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0d585e-f763-4798-9c16-6d3694c1e4c3]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.f795539e-cd08-4b5e-9798-a5eecb77a5ab {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:24 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.f795539e-cd08-4b5e-9798-a5eecb77a5ab Nov 02 10:48:24 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:25 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.f795539e-cd08-4b5e-9798-a5eecb77a5ab" returned: 0 in 0.672s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:48:25 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc1d1a7-3840-4214-a00a-097fa287816a]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:25 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838 Nov 02 10:48:25 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:25 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838" returned: 0 in 0.582s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.f795539e-cd08-4b5e-9798-a5eecb77a5ab {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:25 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.f795539e-cd08-4b5e-9798-a5eecb77a5ab Nov 02 10:48:25 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:26 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.f795539e-cd08-4b5e-9798-a5eecb77a5ab" returned: 0 in 0.553s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.f795539e-cd08-4b5e-9798-a5eecb77a5ab {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:26 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.f795539e-cd08-4b5e-9798-a5eecb77a5ab Nov 02 10:48:26 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:26 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838.f795539e-cd08-4b5e-9798-a5eecb77a5ab" returned: 0 in 0.406s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-f795539e-cd08-4b5e-9798-a5eecb77a5ab" released by "_delete_snapshot" :: held 2.403s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-c53a3255-c8c7-4a40-acd7-10f82f0b4838" released by "delete_snapshot" :: held 2.437s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:26 devstack cinder-volume[87084]: WARNING cinder.quota [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-394982876 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-394982876, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:48:26 devstack cinder-volume[87084]: WARNING cinder.quota [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-394982876 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-394982876, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:48:26 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Created reservations ['a856e276-e139-4895-9949-0de125658583', '4669c4d0-7bda-4dae-9ddb-5a886f34f09d', '94280919-9637-49fe-983d-052b174ddc96', 'bc5aae25-ed4b-4f92-917d-4551f8951622'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:48:26 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] Created reservations ['fb7282eb-e912-4a87-ab7e-af1a8cce0196', '31d727d7-975a-4c53-82c4-a1ac99dc755f', '77afb610-6528-4646-800b-9fc9fff67166', 'd5200ee8-2c7a-413c-9d83-ad3aa59e72e2'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:48:27 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-fd866823-38eb-43ca-97e2-78b22fc8c515 tempest-GroupSnapshotsTest-1904442589 None] group_snapshot 2f254cff-5d1d-416e-93e6-53ee686de3fb: deleted successfully Nov 02 10:48:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "cinder-quobyte-c53a3255-c8c7-4a40-acd7-10f82f0b4838" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-c53a3255-c8c7-4a40-acd7-10f82f0b4838" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:28 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc3800b-c909-4e69-9e5a-58c6467af55c]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:29 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838 Nov 02 10:48:29 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:29 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838" returned: 0 in 0.534s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:29 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838 Nov 02 10:48:29 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:29 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 /opt/stack/data/cinder/conversion/150779b5-40c5-4c7c-bed5-f253ca9b2ce1.temp_image.836b94b6-78c4-4f3d-b646-9aaa3152dd6dtmezsj1y.img" returned: 0 in 6.516s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:29 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b65e82a-df9a-4aed-b2ec-d474d4adc2f5]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:29 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 Nov 02 10:48:29 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:29 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c53a3255-c8c7-4a40-acd7-10f82f0b4838" returned: 0 in 0.288s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-c53a3255-c8c7-4a40-acd7-10f82f0b4838" released by "delete_volume" :: held 0.950s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "cinder-quobyte-ede68d61-dd37-4452-9bd5-6519e2cd3c84" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-ede68d61-dd37-4452-9bd5-6519e2cd3c84" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:29 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c456acb8-f409-4184-83a3-23e5c2041cb1]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:29 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84 Nov 02 10:48:29 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:30 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1" returned: 0 in 0.545s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] Image conversion details: src /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/conversion/150779b5-40c5-4c7c-bed5-f253ca9b2ce1.temp_image.836b94b6-78c4-4f3d-b646-9aaa3152dd6dtmezsj1y.img {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:48:30 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] Converted 1024.00 MB image at 157.13 MB/s Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] 836b94b6-78c4-4f3d-b646-9aaa3152dd6d was raw, converting to qcow2 {{(pid=87084) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b446c79-6316-4813-a66d-3ba1d0148e07]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/150779b5-40c5-4c7c-bed5-f253ca9b2ce1.temp_image.836b94b6-78c4-4f3d-b646-9aaa3152dd6dtmezsj1y.img {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:30 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84" returned: 0 in 0.380s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:30 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84 Nov 02 10:48:30 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:30 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/150779b5-40c5-4c7c-bed5-f253ca9b2ce1.temp_image.836b94b6-78c4-4f3d-b646-9aaa3152dd6dtmezsj1y.img Nov 02 10:48:30 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:30 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ede68d61-dd37-4452-9bd5-6519e2cd3c84" returned: 0 in 0.243s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-ede68d61-dd37-4452-9bd5-6519e2cd3c84" released by "delete_volume" :: held 0.683s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:30 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/150779b5-40c5-4c7c-bed5-f253ca9b2ce1.temp_image.836b94b6-78c4-4f3d-b646-9aaa3152dd6dtmezsj1y.img" returned: 0 in 0.357s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/150779b5-40c5-4c7c-bed5-f253ca9b2ce1.temp_image.836b94b6-78c4-4f3d-b646-9aaa3152dd6dtmezsj1y.img {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Created reservations ['9036fd7f-c863-452f-bade-17a2edd982d6'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:48:30 devstack cinder-volume[87084]: WARNING cinder.quota [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-394982876 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-394982876, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Created reservations ['93c78048-1ce1-417b-9f2a-817957044a8b', 'a8e3949b-ef73-49ed-bc15-389c58c95d64', 'da350de9-695b-4eb3-9168-0cbfabd366b3', 'b41e7dd3-4c7a-4f23-b9df-8d3134a24d37'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:48:30 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/150779b5-40c5-4c7c-bed5-f253ca9b2ce1.temp_image.836b94b6-78c4-4f3d-b646-9aaa3152dd6dtmezsj1y.img Nov 02 10:48:30 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Created reservations ['05ff006a-936e-40ac-9a24-47bfd02782a5', 'ddb4212b-30eb-4265-925b-71ce40e241cd', 'ff61428c-ad60-47f4-b6bf-1e090651598c', 'bef255fa-33c3-43b9-93f0-adb531232623'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:30 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:48:30 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:30 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/150779b5-40c5-4c7c-bed5-f253ca9b2ce1.temp_image.836b94b6-78c4-4f3d-b646-9aaa3152dd6dtmezsj1y.img" returned: 1 in 0.347s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/150779b5-40c5-4c7c-bed5-f253ca9b2ce1.temp_image.836b94b6-78c4-4f3d-b646-9aaa3152dd6dtmezsj1y.img' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:48:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/150779b5-40c5-4c7c-bed5-f253ca9b2ce1.temp_image.836b94b6-78c4-4f3d-b646-9aaa3152dd6dtmezsj1y.img /opt/stack/data/cinder/conversion/vol_upload_pro50cz9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:30 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/150779b5-40c5-4c7c-bed5-f253ca9b2ce1.temp_image.836b94b6-78c4-4f3d-b646-9aaa3152dd6dtmezsj1y.img /opt/stack/data/cinder/conversion/vol_upload_pro50cz9 Nov 02 10:48:30 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:31 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.254s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:31 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:48:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-41332594-b1f4-4004-ae7e-ae016519f040 tempest-GroupSnapshotsTest-1904442589 None] Delete group completed successfully. Nov 02 10:48:31 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/150779b5-40c5-4c7c-bed5-f253ca9b2ce1.temp_image.836b94b6-78c4-4f3d-b646-9aaa3152dd6dtmezsj1y.img /opt/stack/data/cinder/conversion/vol_upload_pro50cz9" returned: 0 in 0.245s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:31 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] Image conversion details: src /opt/stack/data/cinder/conversion/150779b5-40c5-4c7c-bed5-f253ca9b2ce1.temp_image.836b94b6-78c4-4f3d-b646-9aaa3152dd6dtmezsj1y.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_pro50cz9 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:48:31 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 02 10:48:31 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4364e34-c097-454d-8dff-c7bfa86cc405]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pro50cz9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:31 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pro50cz9 Nov 02 10:48:31 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:31 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pro50cz9" returned: 0 in 0.369s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-11a124cf-eb1b-49e7-a4dc-e85ab90ac24d tempest-GroupSnapshotsTest-1904442589 None] Group tempest-GroupSnapshotsTest-Group-2086252125: creating Nov 02 10:48:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-11a124cf-eb1b-49e7-a4dc-e85ab90ac24d tempest-GroupSnapshotsTest-1904442589 None] Group tempest-GroupSnapshotsTest-Group-2086252125: created successfully Nov 02 10:48:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-11a124cf-eb1b-49e7-a4dc-e85ab90ac24d tempest-GroupSnapshotsTest-1904442589 None] Create group completed successfully. Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.715s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] Uploaded volume to glance image-id: 836b94b6-78c4-4f3d-b646-9aaa3152dd6d. {{(pid=87084) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 39.943s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1477713182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6315f3d4-495a-44f8-8383-7ab35b44d915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8cc75013b7b4744ba25131600d3ac39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:53Z,use_quota=True,user_id='e6701669955b439fa9fedb5e2f760712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd93453f-42cd-4b26-afa3-3838b8184d42),volume_type_id=cd93453f-42cd-4b26-afa3-3838b8184d42)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Creating volume 6315f3d4-495a-44f8-8383-7ab35b44d915 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:48:33 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6315f3d4-495a-44f8-8383-7ab35b44d915 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:33 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6315f3d4-495a-44f8-8383-7ab35b44d915 1073741824 Nov 02 10:48:33 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6ef59686-f409-4717-9162-95dd3b44d721 tempest-VolumesActionsTest-1313225901 None] Copy volume to image completed successfully. Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Flow 'volume_create_manager' (24c76ac3-4b59-4c4c-a215-aaa216414dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a2fe21-e278-4133-a2e8-30073976afbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a2fe21-e278-4133-a2e8-30073976afbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1975322818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91bf47b7-8368-4882-a912-8078bb2021b9,host='devstack@QuobyteHD#QuobyteHD',id=d863df6f-fd47-47b2-a1c4-cc42ebfc92a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f562055a548049e7bcf745ed39e55969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:33Z,use_quota=True,user_id='86d438cf9cc042dc995c288b2c62d4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4f86f26-be2c-4c9b-a415-bad9687b8b00),volume_type_id=c4f86f26-be2c-4c9b-a415-bad9687b8b00)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43933194-3a69-4393-bbba-6bad065be368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43933194-3a69-4393-bbba-6bad065be368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff03f69-0e39-4d38-a9d3-19f7ebdcd46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff03f69-0e39-4d38-a9d3-19f7ebdcd46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd863df6f-fd47-47b2-a1c4-cc42ebfc92a0', 'volume_name': 'volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae7b2bc-a4be-40d1-acf7-75c6e59a7a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae7b2bc-a4be-40d1-acf7-75c6e59a7a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ef2e24-0426-4bb9-98f7-646f23a5db2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:33 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Volume d863df6f-fd47-47b2-a1c4-cc42ebfc92a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0', 'volume_size': 1} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:33 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6315f3d4-495a-44f8-8383-7ab35b44d915 1073741824" returned: 0 in 0.562s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6315f3d4-495a-44f8-8383-7ab35b44d915 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:33 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6315f3d4-495a-44f8-8383-7ab35b44d915 Nov 02 10:48:33 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:33 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6315f3d4-495a-44f8-8383-7ab35b44d915" returned: 0 in 0.249s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-47169b95-02d2-4f59-b919-dc518ba634be tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.825s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab430fba-8e63-4a45-a69d-3e2649f7e820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6315f3d4-495a-44f8-8383-7ab35b44d915', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597d8aa8-aab6-4251-9e8e-33bee5f47ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-47169b95-02d2-4f59-b919-dc518ba634be tempest-VolumesSnapshotTestJSON-1799736696 None] Creating offline snapshot e75356ca-1ee4-4046-99db-3aeccd448e98 of volume bf4085ca-6ca7-46d2-b9e8-637359adaed1 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:48:33 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Volume volume-6315f3d4-495a-44f8-8383-7ab35b44d915 (6315f3d4-495a-44f8-8383-7ab35b44d915): created successfully Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597d8aa8-aab6-4251-9e8e-33bee5f47ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Flow 'volume_create_manager' (98e6ffc2-361c-4e13-9359-f83bc7d6a67a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b38e07-f8de-4963-93ae-e3eb16e609c0]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-47169b95-02d2-4f59-b919-dc518ba634be tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b81b6a9c-29aa-43c9-9b29-5c00b8484554 tempest-VolumeTypesAccessTest-1026057129 None] Created volume successfully. Nov 02 10:48:34 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1 Nov 02 10:48:34 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] Acquiring lock "cinder-6315f3d4-495a-44f8-8383-7ab35b44d915-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] Lock "cinder-6315f3d4-495a-44f8-8383-7ab35b44d915-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] Acquiring lock "cinder-quobyte-6315f3d4-495a-44f8-8383-7ab35b44d915" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] Lock "cinder-quobyte-6315f3d4-495a-44f8-8383-7ab35b44d915" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:34 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf653831-89d7-441d-b7ae-47810e1881e9]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6315f3d4-495a-44f8-8383-7ab35b44d915 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:34 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-47169b95-02d2-4f59-b919-dc518ba634be tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1" returned: 0 in 0.413s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-47169b95-02d2-4f59-b919-dc518ba634be tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.e75356ca-1ee4-4046-99db-3aeccd448e98 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:34 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.e75356ca-1ee4-4046-99db-3aeccd448e98 1G Nov 02 10:48:34 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:34 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6315f3d4-495a-44f8-8383-7ab35b44d915 Nov 02 10:48:34 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aae94369-4779-4e13-be6d-f66b479b8270 tempest-VolumesActionsTest-1313225901 None] Acquiring lock "cinder-150779b5-40c5-4c7c-bed5-f253ca9b2ce1-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aae94369-4779-4e13-be6d-f66b479b8270 tempest-VolumesActionsTest-1313225901 None] Lock "cinder-150779b5-40c5-4c7c-bed5-f253ca9b2ce1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aae94369-4779-4e13-be6d-f66b479b8270 tempest-VolumesActionsTest-1313225901 None] Acquiring lock "cinder-quobyte-150779b5-40c5-4c7c-bed5-f253ca9b2ce1" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aae94369-4779-4e13-be6d-f66b479b8270 tempest-VolumesActionsTest-1313225901 None] Lock "cinder-quobyte-150779b5-40c5-4c7c-bed5-f253ca9b2ce1" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:34 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[697e102a-d546-49f8-a11c-b6f29ccd3efa]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aae94369-4779-4e13-be6d-f66b479b8270 tempest-VolumesActionsTest-1313225901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:34 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6315f3d4-495a-44f8-8383-7ab35b44d915" returned: 0 in 0.525s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6315f3d4-495a-44f8-8383-7ab35b44d915 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:34 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6315f3d4-495a-44f8-8383-7ab35b44d915 Nov 02 10:48:34 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:34 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 Nov 02 10:48:34 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:34 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-47169b95-02d2-4f59-b919-dc518ba634be tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.e75356ca-1ee4-4046-99db-3aeccd448e98 1G" returned: 0 in 0.569s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-47169b95-02d2-4f59-b919-dc518ba634be tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.e75356ca-1ee4-4046-99db-3aeccd448e98 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:34 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.e75356ca-1ee4-4046-99db-3aeccd448e98 Nov 02 10:48:34 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:35 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6315f3d4-495a-44f8-8383-7ab35b44d915" returned: 0 in 0.290s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] Lock "cinder-quobyte-6315f3d4-495a-44f8-8383-7ab35b44d915" released by "delete_volume" :: held 0.865s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:35 devstack cinder-volume[87084]: WARNING cinder.quota [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-775728291 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-775728291, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:48:35 devstack cinder-volume[87084]: WARNING cinder.quota [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-775728291 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-775728291, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] Created reservations ['ebe3465e-e97d-425f-8ad2-635079763839', '51158697-eff7-44d4-86a7-f4c866377c63', '52a7b67f-6212-44e2-b958-a19ffe5dd6ac', '4a13f9c5-97fb-48d9-8ef1-0ea4b450d322'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:48:35 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aae94369-4779-4e13-be6d-f66b479b8270 tempest-VolumesActionsTest-1313225901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1" returned: 0 in 0.450s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aae94369-4779-4e13-be6d-f66b479b8270 tempest-VolumesActionsTest-1313225901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:35 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1 Nov 02 10:48:35 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:35 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-47169b95-02d2-4f59-b919-dc518ba634be tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.e75356ca-1ee4-4046-99db-3aeccd448e98" returned: 0 in 0.358s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:35 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-47169b95-02d2-4f59-b919-dc518ba634be tempest-VolumesSnapshotTestJSON-1799736696 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.e75356ca-1ee4-4046-99db-3aeccd448e98 is being set with open permissions: ugo+rw Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-47169b95-02d2-4f59-b919-dc518ba634be tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.e75356ca-1ee4-4046-99db-3aeccd448e98 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:35 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.e75356ca-1ee4-4046-99db-3aeccd448e98 Nov 02 10:48:35 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:35 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:48:35 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:35 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aae94369-4779-4e13-be6d-f66b479b8270 tempest-VolumesActionsTest-1313225901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-150779b5-40c5-4c7c-bed5-f253ca9b2ce1" returned: 0 in 0.328s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aae94369-4779-4e13-be6d-f66b479b8270 tempest-VolumesActionsTest-1313225901 None] Lock "cinder-quobyte-150779b5-40c5-4c7c-bed5-f253ca9b2ce1" released by "delete_volume" :: held 0.830s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-aae94369-4779-4e13-be6d-f66b479b8270 tempest-VolumesActionsTest-1313225901 None] Created reservations ['1b6aaa2c-0b7b-43da-b975-55251425c983', '6842d801-444f-4fe3-8199-33295c3d1149', 'a15b252c-2863-4c06-8c76-668db2bf9508', '6025b52d-6d65-4210-8299-a7d099516b74'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:48:35 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-47169b95-02d2-4f59-b919-dc518ba634be tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.e75356ca-1ee4-4046-99db-3aeccd448e98" returned: 0 in 0.343s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:35 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-47169b95-02d2-4f59-b919-dc518ba634be tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.379s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:48:35 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.info Nov 02 10:48:35 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:35 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] Deleted volume successfully. Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1e9e5e20-e294-46ca-992f-2fef94bc3e12 tempest-VolumeTypesAccessTest-1026057129 None] Lock "cinder-6315f3d4-495a-44f8-8383-7ab35b44d915-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-aae94369-4779-4e13-be6d-f66b479b8270 tempest-VolumesActionsTest-1313225901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-aae94369-4779-4e13-be6d-f66b479b8270 tempest-VolumesActionsTest-1313225901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-aae94369-4779-4e13-be6d-f66b479b8270 tempest-VolumesActionsTest-1313225901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-aae94369-4779-4e13-be6d-f66b479b8270 tempest-VolumesActionsTest-1313225901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-aae94369-4779-4e13-be6d-f66b479b8270 tempest-VolumesActionsTest-1313225901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aae94369-4779-4e13-be6d-f66b479b8270 tempest-VolumesActionsTest-1313225901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:35 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:48:35 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:36 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-47169b95-02d2-4f59-b919-dc518ba634be tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.info" returned: 0 in 0.427s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:36 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-47169b95-02d2-4f59-b919-dc518ba634be tempest-VolumesSnapshotTestJSON-1799736696 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.info is being set with open permissions: ugo+rw Nov 02 10:48:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-47169b95-02d2-4f59-b919-dc518ba634be tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:36 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aae94369-4779-4e13-be6d-f66b479b8270 tempest-VolumesActionsTest-1313225901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.306s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:36 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-aae94369-4779-4e13-be6d-f66b479b8270 tempest-VolumesActionsTest-1313225901 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:48:36 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.info Nov 02 10:48:36 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:36 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-aae94369-4779-4e13-be6d-f66b479b8270 tempest-VolumesActionsTest-1313225901 None] Deleted volume successfully. Nov 02 10:48:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aae94369-4779-4e13-be6d-f66b479b8270 tempest-VolumesActionsTest-1313225901 None] Lock "cinder-150779b5-40c5-4c7c-bed5-f253ca9b2ce1-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:36 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-47169b95-02d2-4f59-b919-dc518ba634be tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.info" returned: 0 in 0.284s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-47169b95-02d2-4f59-b919-dc518ba634be tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.553s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.899s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=91bf47b7-8368-4882-a912-8078bb2021b9,created_at=2026-11-02T09:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1975322818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91bf47b7-8368-4882-a912-8078bb2021b9,host='devstack@QuobyteHD#QuobyteHD',id=d863df6f-fd47-47b2-a1c4-cc42ebfc92a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f562055a548049e7bcf745ed39e55969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:33Z,use_quota=True,user_id='86d438cf9cc042dc995c288b2c62d4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4f86f26-be2c-4c9b-a415-bad9687b8b00),volume_type_id=c4f86f26-be2c-4c9b-a415-bad9687b8b00)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:48:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Creating volume d863df6f-fd47-47b2-a1c4-cc42ebfc92a0 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:48:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:48:36 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:48:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:36 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0 1073741824 Nov 02 10:48:36 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:36 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-47169b95-02d2-4f59-b919-dc518ba634be tempest-VolumesSnapshotTestJSON-1799736696 None] Create snapshot completed successfully Nov 02 10:48:37 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0 1073741824" returned: 0 in 0.667s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-e75356ca-1ee4-4046-99db-3aeccd448e98-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-e75356ca-1ee4-4046-99db-3aeccd448e98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-quobyte-bf4085ca-6ca7-46d2-b9e8-637359adaed1" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:37 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0 Nov 02 10:48:37 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-bf4085ca-6ca7-46d2-b9e8-637359adaed1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-quobyte-e75356ca-1ee4-4046-99db-3aeccd448e98" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-e75356ca-1ee4-4046-99db-3aeccd448e98" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] Deleting offline snapshot e75356ca-1ee4-4046-99db-3aeccd448e98 of volume bf4085ca-6ca7-46d2-b9e8-637359adaed1 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] snapshot_file for this snap is: volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.e75356ca-1ee4-4046-99db-3aeccd448e98 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e63cb23-1114-4fb8-8017-8cb60d1049fa]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.e75356ca-1ee4-4046-99db-3aeccd448e98 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:37 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.e75356ca-1ee4-4046-99db-3aeccd448e98 Nov 02 10:48:37 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:37 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0" returned: 0 in 0.310s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ef2e24-0426-4bb9-98f7-646f23a5db2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bea434e-173b-4cac-b65c-aa860f6f95f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:37 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Volume volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0 (d863df6f-fd47-47b2-a1c4-cc42ebfc92a0): created successfully Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bea434e-173b-4cac-b65c-aa860f6f95f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Flow 'volume_create_manager' (24c76ac3-4b59-4c4c-a215-aaa216414dcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-59e44ba7-deb9-4c72-9e6d-6d2572ef0c78 tempest-GroupSnapshotsTest-1904442589 None] Created volume successfully. Nov 02 10:48:37 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.e75356ca-1ee4-4046-99db-3aeccd448e98" returned: 0 in 0.502s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0021be-cfa8-49fc-9357-fdce86257744]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:37 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1 Nov 02 10:48:37 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:38 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1" returned: 0 in 0.460s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.e75356ca-1ee4-4046-99db-3aeccd448e98 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:38 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.e75356ca-1ee4-4046-99db-3aeccd448e98 Nov 02 10:48:38 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:38 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] GroupSnapshot 718d5c36-1de7-4985-bd26-7a10a6681df3: creating. Nov 02 10:48:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] Group snapshot 718d5c36-1de7-4985-bd26-7a10a6681df3: creating. {{(pid=87084) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:48:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] Creating offline snapshot d596f99f-4170-4cbf-a5f4-6a18cb09af4d of volume d863df6f-fd47-47b2-a1c4-cc42ebfc92a0 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:48:38 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1c0275-c4b0-4ddc-97d1-6064283aea50]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:38 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.e75356ca-1ee4-4046-99db-3aeccd448e98" returned: 0 in 0.491s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.e75356ca-1ee4-4046-99db-3aeccd448e98 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:38 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.e75356ca-1ee4-4046-99db-3aeccd448e98 Nov 02 10:48:38 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:38 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0 Nov 02 10:48:38 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:39 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1.e75356ca-1ee4-4046-99db-3aeccd448e98" returned: 0 in 0.332s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-e75356ca-1ee4-4046-99db-3aeccd448e98" released by "_delete_snapshot" :: held 1.952s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-bf4085ca-6ca7-46d2-b9e8-637359adaed1" released by "delete_snapshot" :: held 1.989s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:39 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0" returned: 0 in 0.516s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.d596f99f-4170-4cbf-a5f4-6a18cb09af4d 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:39 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.d596f99f-4170-4cbf-a5f4-6a18cb09af4d 1G Nov 02 10:48:39 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:39 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] Created reservations ['19fd4968-8d71-4190-9a54-1aacf6d39652', 'b831dcea-75a8-4e7a-954f-24ef47e7fd54', 'c4839a9e-94ce-4862-9192-a517f031a3fc', '48b14c21-4017-4aba-a2c3-f6dca4f1c156'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:48:39 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] Delete snapshot completed successfully. Nov 02 10:48:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0c95021c-489a-45e9-a6b8-5785aa9a43f5 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-e75356ca-1ee4-4046-99db-3aeccd448e98-delete_snapshot" released by "delete_snapshot" :: held 2.339s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:39 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.d596f99f-4170-4cbf-a5f4-6a18cb09af4d 1G" returned: 0 in 0.563s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.d596f99f-4170-4cbf-a5f4-6a18cb09af4d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:39 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.d596f99f-4170-4cbf-a5f4-6a18cb09af4d Nov 02 10:48:39 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:40 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.d596f99f-4170-4cbf-a5f4-6a18cb09af4d" returned: 0 in 0.329s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:40 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.d596f99f-4170-4cbf-a5f4-6a18cb09af4d is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:48:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.d596f99f-4170-4cbf-a5f4-6a18cb09af4d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:40 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.d596f99f-4170-4cbf-a5f4-6a18cb09af4d Nov 02 10:48:40 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:40 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.d596f99f-4170-4cbf-a5f4-6a18cb09af4d" returned: 0 in 0.394s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:40 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.info Nov 02 10:48:40 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:40 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.info" returned: 0 in 0.300s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:40 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:48:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:40 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.info Nov 02 10:48:40 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:41 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.info" returned: 0 in 0.261s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.482s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Flow 'volume_create_manager' (c6a3eda5-3dde-494f-9d8d-0517d6dbefd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289047c6-7181-496a-886d-1b6da1abf16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289047c6-7181-496a-886d-1b6da1abf16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1328318745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7370df8-ef60-4c6e-8ce5-f03923bfab6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169ccc547bf64525ae2a8f2f0943407f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:41Z,use_quota=True,user_id='347d5bcf8db94613a831bb8af5a413c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd86fc7-08ca-402a-bfd3-dd643d6fdb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd86fc7-08ca-402a-bfd3-dd643d6fdb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd6aba2-b38e-455f-8e19-3d1ba88f8701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd6aba2-b38e-455f-8e19-3d1ba88f8701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7370df8-ef60-4c6e-8ce5-f03923bfab6e', 'volume_name': 'volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b13ee6-0a30-4dbd-9c97-ae66c4f8b349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b13ee6-0a30-4dbd-9c97-ae66c4f8b349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4171f3f-3acd-45d2-89aa-c7cf184992d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Volume e7370df8-ef60-4c6e-8ce5-f03923bfab6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e', 'volume_size': 1} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1328318745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7370df8-ef60-4c6e-8ce5-f03923bfab6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169ccc547bf64525ae2a8f2f0943407f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:41Z,use_quota=True,user_id='347d5bcf8db94613a831bb8af5a413c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Creating volume e7370df8-ef60-4c6e-8ce5-f03923bfab6e {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:48:41 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:48:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-137f8376-ceea-416b-8b87-fa4ae8722d1a tempest-GroupSnapshotsTest-1904442589 None] group_snapshot 718d5c36-1de7-4985-bd26-7a10a6681df3: created successfully Nov 02 10:48:41 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e 1073741824 Nov 02 10:48:41 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:42 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e 1073741824" returned: 0 in 0.646s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:42 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] group_snapshot 718d5c36-1de7-4985-bd26-7a10a6681df3: deleting Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:42 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e Nov 02 10:48:42 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] group_snapshot 718d5c36-1de7-4985-bd26-7a10a6681df3: deleting {{(pid=87084) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "cinder-quobyte-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "cinder-quobyte-d596f99f-4170-4cbf-a5f4-6a18cb09af4d" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-d596f99f-4170-4cbf-a5f4-6a18cb09af4d" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] Deleting offline snapshot d596f99f-4170-4cbf-a5f4-6a18cb09af4d of volume d863df6f-fd47-47b2-a1c4-cc42ebfc92a0 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] snapshot_file for this snap is: volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.d596f99f-4170-4cbf-a5f4-6a18cb09af4d {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4a029d-129c-4f61-847c-61fb97d0c0e7]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.d596f99f-4170-4cbf-a5f4-6a18cb09af4d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:42 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e" returned: 0 in 0.325s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4171f3f-3acd-45d2-89aa-c7cf184992d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f97e336-281e-4734-91a3-fd86db8bb241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:42 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Volume volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e (e7370df8-ef60-4c6e-8ce5-f03923bfab6e): created successfully Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f97e336-281e-4734-91a3-fd86db8bb241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Flow 'volume_create_manager' (c6a3eda5-3dde-494f-9d8d-0517d6dbefd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:42 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3e5231f0-f99f-4d0b-b3dc-79f961ab29e1 tempest-VolumesSnapshotTestJSON-1799736696 None] Created volume successfully. Nov 02 10:48:42 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.d596f99f-4170-4cbf-a5f4-6a18cb09af4d Nov 02 10:48:42 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:42 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.d596f99f-4170-4cbf-a5f4-6a18cb09af4d" returned: 0 in 0.450s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad04357b-0a4b-418b-8d01-74278d6045ff]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:43 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0 Nov 02 10:48:43 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:43 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0" returned: 0 in 0.493s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.d596f99f-4170-4cbf-a5f4-6a18cb09af4d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:43 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.d596f99f-4170-4cbf-a5f4-6a18cb09af4d Nov 02 10:48:43 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b451a1d3-839f-42b3-b321-84652d00a0b4 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b451a1d3-839f-42b3-b321-84652d00a0b4 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b451a1d3-839f-42b3-b321-84652d00a0b4 tempest-VolumesSnapshotTestJSON-1799736696 None] Creating offline snapshot ec0a2bc9-8041-4813-94ca-ac4e6309d618 of volume e7370df8-ef60-4c6e-8ce5-f03923bfab6e {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:48:43 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[df91e302-1caa-4d2e-ab90-cdb172330b18]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b451a1d3-839f-42b3-b321-84652d00a0b4 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:43 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e Nov 02 10:48:43 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:43 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.d596f99f-4170-4cbf-a5f4-6a18cb09af4d" returned: 0 in 0.570s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.d596f99f-4170-4cbf-a5f4-6a18cb09af4d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:44 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.d596f99f-4170-4cbf-a5f4-6a18cb09af4d Nov 02 10:48:44 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:44 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b451a1d3-839f-42b3-b321-84652d00a0b4 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e" returned: 0 in 0.518s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b451a1d3-839f-42b3-b321-84652d00a0b4 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:44 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0.d596f99f-4170-4cbf-a5f4-6a18cb09af4d" returned: 0 in 0.368s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:44 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618 1G Nov 02 10:48:44 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-d596f99f-4170-4cbf-a5f4-6a18cb09af4d" released by "_delete_snapshot" :: held 2.093s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0" released by "delete_snapshot" :: held 2.145s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:44 devstack cinder-volume[87084]: WARNING cinder.quota [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-75035916 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-75035916, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:48:44 devstack cinder-volume[87084]: WARNING cinder.quota [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-75035916 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-75035916, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:48:44 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] Created reservations ['c8ce99bd-766e-4f3e-b712-a174c6716252', '090fb4f2-8326-4b6f-b522-97e4aee91061', '61048005-04a3-45c8-be5e-f0817a4f5e88', '842c622f-31c5-46ae-90bb-1e75d7ad3a1c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:48:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d784026f-ea78-411c-b1ff-0cc67a493202 tempest-GroupSnapshotsTest-1904442589 None] group_snapshot 718d5c36-1de7-4985-bd26-7a10a6681df3: deleted successfully Nov 02 10:48:44 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b451a1d3-839f-42b3-b321-84652d00a0b4 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618 1G" returned: 0 in 0.538s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b451a1d3-839f-42b3-b321-84652d00a0b4 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:44 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618 Nov 02 10:48:44 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:45 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b451a1d3-839f-42b3-b321-84652d00a0b4 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618" returned: 0 in 0.331s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:45 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-b451a1d3-839f-42b3-b321-84652d00a0b4 tempest-VolumesSnapshotTestJSON-1799736696 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618 is being set with open permissions: ugo+rw Nov 02 10:48:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b451a1d3-839f-42b3-b321-84652d00a0b4 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:45 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618 Nov 02 10:48:45 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:45 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b451a1d3-839f-42b3-b321-84652d00a0b4 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618" returned: 0 in 0.315s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b451a1d3-839f-42b3-b321-84652d00a0b4 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:45 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.info Nov 02 10:48:45 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:45 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b451a1d3-839f-42b3-b321-84652d00a0b4 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.info" returned: 0 in 0.391s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:45 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-b451a1d3-839f-42b3-b321-84652d00a0b4 tempest-VolumesSnapshotTestJSON-1799736696 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.info is being set with open permissions: ugo+rw Nov 02 10:48:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b451a1d3-839f-42b3-b321-84652d00a0b4 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:45 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.info Nov 02 10:48:45 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0bbf38db-0771-4193-9bfa-0640ab4ac278 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "cinder-quobyte-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0bbf38db-0771-4193-9bfa-0640ab4ac278 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0" acquired by "delete_volume" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:46 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a8c481-908d-40ca-9e4c-c2f2426bdad1]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0bbf38db-0771-4193-9bfa-0640ab4ac278 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:46 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b451a1d3-839f-42b3-b321-84652d00a0b4 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.info" returned: 0 in 0.342s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b451a1d3-839f-42b3-b321-84652d00a0b4 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.550s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:46 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b451a1d3-839f-42b3-b321-84652d00a0b4 tempest-VolumesSnapshotTestJSON-1799736696 None] Create snapshot completed successfully Nov 02 10:48:46 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0 Nov 02 10:48:46 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:46 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0bbf38db-0771-4193-9bfa-0640ab4ac278 tempest-GroupSnapshotsTest-1904442589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0" returned: 0 in 0.446s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0bbf38db-0771-4193-9bfa-0640ab4ac278 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:46 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0 Nov 02 10:48:46 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:46 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0bbf38db-0771-4193-9bfa-0640ab4ac278 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0" returned: 0 in 0.309s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0bbf38db-0771-4193-9bfa-0640ab4ac278 tempest-GroupSnapshotsTest-1904442589 None] Lock "cinder-quobyte-d863df6f-fd47-47b2-a1c4-cc42ebfc92a0" released by "delete_volume" :: held 0.851s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-0bbf38db-0771-4193-9bfa-0640ab4ac278 tempest-GroupSnapshotsTest-1904442589 None] Created reservations ['2a4d8187-7cdf-4aa4-987a-a41ecc55e5fd'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:48:47 devstack cinder-volume[87084]: WARNING cinder.quota [None req-0bbf38db-0771-4193-9bfa-0640ab4ac278 tempest-GroupSnapshotsTest-1904442589 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-75035916 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-75035916, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-0bbf38db-0771-4193-9bfa-0640ab4ac278 tempest-GroupSnapshotsTest-1904442589 None] Created reservations ['ceedb4d8-c3f4-4342-96bb-f6f8dc968e89', 'f305c12d-f2fc-449a-af15-457fdc142e05', '57e83f10-d17e-469d-9f33-0837a1bde847', '60108949-622e-4487-b62c-8d1fa18c0be7'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0bbf38db-0771-4193-9bfa-0640ab4ac278 tempest-GroupSnapshotsTest-1904442589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0bbf38db-0771-4193-9bfa-0640ab4ac278 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0bbf38db-0771-4193-9bfa-0640ab4ac278 tempest-GroupSnapshotsTest-1904442589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0bbf38db-0771-4193-9bfa-0640ab4ac278 tempest-GroupSnapshotsTest-1904442589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0bbf38db-0771-4193-9bfa-0640ab4ac278 tempest-GroupSnapshotsTest-1904442589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0bbf38db-0771-4193-9bfa-0640ab4ac278 tempest-GroupSnapshotsTest-1904442589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:47 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:48:47 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Flow 'volume_create_manager' (e61d53bb-e4e7-4d8f-bf09-893299e51460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04dd288f-d274-48d5-9655-ca29cbae0f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04dd288f-d274-48d5-9655-ca29cbae0f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1174522220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ff3918-fd24-465a-bf81-2a0975ffe207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169ccc547bf64525ae2a8f2f0943407f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ec0a2bc9-8041-4813-94ca-ac4e6309d618,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:48Z,use_quota=True,user_id='347d5bcf8db94613a831bb8af5a413c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:47 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c894028-9135-4172-a94f-a0ceddcfff8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c894028-9135-4172-a94f-a0ceddcfff8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6fa61d6-d1a8-404b-b0f2-68e3626bcc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6fa61d6-d1a8-404b-b0f2-68e3626bcc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '57ff3918-fd24-465a-bf81-2a0975ffe207', 'volume_name': 'volume-57ff3918-fd24-465a-bf81-2a0975ffe207', 'volume_size': 2, 'snapshot_id': 'ec0a2bc9-8041-4813-94ca-ac4e6309d618'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc22316-c8d5-4155-adcd-aa5e9c20cc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc22316-c8d5-4155-adcd-aa5e9c20cc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3e9676-57e0-405a-be94-96e9ab35ffe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:47 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Volume 57ff3918-fd24-465a-bf81-2a0975ffe207: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-57ff3918-fd24-465a-bf81-2a0975ffe207', 'volume_size': 2, 'snapshot_id': 'ec0a2bc9-8041-4813-94ca-ac4e6309d618'} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0bbf38db-0771-4193-9bfa-0640ab4ac278 tempest-GroupSnapshotsTest-1904442589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.445s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-0bbf38db-0771-4193-9bfa-0640ab4ac278 tempest-GroupSnapshotsTest-1904442589 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:48:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0bbf38db-0771-4193-9bfa-0640ab4ac278 tempest-GroupSnapshotsTest-1904442589 None] Delete group completed successfully. Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-quobyte-ec0a2bc9-8041-4813-94ca-ac4e6309d618-57ff3918-fd24-465a-bf81-2a0975ffe207" by "_create_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-ec0a2bc9-8041-4813-94ca-ac4e6309d618-57ff3918-fd24-465a-bf81-2a0975ffe207" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Creating volume 57ff3918-fd24-465a-bf81-2a0975ffe207 from snapshot ec0a2bc9-8041-4813-94ca-ac4e6309d618 {{(pid=87084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-quobyte-57ff3918-fd24-465a-bf81-2a0975ffe207" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-57ff3918-fd24-465a-bf81-2a0975ffe207" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] snapshot: ec0a2bc9-8041-4813-94ca-ac4e6309d618, volume: 57ff3918-fd24-465a-bf81-2a0975ffe207, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:47 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[39174528-bc98-492e-bbe1-16b3bf455998]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:48 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618 Nov 02 10:48:48 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:48 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618" returned: 0 in 0.443s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:48:48 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3877b81a-1992-423e-8de8-d350095d9874]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:48 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e Nov 02 10:48:48 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:49 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e" returned: 0 in 0.664s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:48:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:48:49 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Path /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-57ff3918-fd24-465a-bf81-2a0975ffe207 not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:48:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-57ff3918-fd24-465a-bf81-2a0975ffe207 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:49 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-57ff3918-fd24-465a-bf81-2a0975ffe207 Nov 02 10:48:49 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:48:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:53 devstack sudo[97253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:48:53 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:53 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.653s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:48:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:48:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:48:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:48:57 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=94,cinder:SELECT=98,cinder:INSERT=26,cinder:DELETE=2 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:48:57 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=89,cinder:INSERT=21,cinder:UPDATE=91,cinder:DELETE=6 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:48:57 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-57ff3918-fd24-465a-bf81-2a0975ffe207" returned: 0 in 8.851s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:57 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Image conversion details: src /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e, size 1024.00 MB, duration 8.85 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-57ff3918-fd24-465a-bf81-2a0975ffe207 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:48:57 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Converted 1024.00 MB image at 115.67 MB/s Nov 02 10:48:57 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-57ff3918-fd24-465a-bf81-2a0975ffe207 is being set with open permissions: ugo+rw Nov 02 10:48:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-57ff3918-fd24-465a-bf81-2a0975ffe207 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:58 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-57ff3918-fd24-465a-bf81-2a0975ffe207 Nov 02 10:48:58 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:58 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-57ff3918-fd24-465a-bf81-2a0975ffe207" returned: 0 in 0.277s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-57ff3918-fd24-465a-bf81-2a0975ffe207" released by "_copy_volume_from_snapshot" :: held 10.358s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-ec0a2bc9-8041-4813-94ca-ac4e6309d618-57ff3918-fd24-465a-bf81-2a0975ffe207" released by "_create_volume_from_snapshot" :: held 10.443s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.466s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3e9676-57e0-405a-be94-96e9ab35ffe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57ff3918-fd24-465a-bf81-2a0975ffe207', 'volume_size': 2, 'snapshot_id': 'ec0a2bc9-8041-4813-94ca-ac4e6309d618'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e04cf025-4004-457d-8d01-c293bb142f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:58 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Volume volume-57ff3918-fd24-465a-bf81-2a0975ffe207 (57ff3918-fd24-465a-bf81-2a0975ffe207): created successfully Nov 02 10:48:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e04cf025-4004-457d-8d01-c293bb142f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Flow 'volume_create_manager' (e61d53bb-e4e7-4d8f-bf09-893299e51460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:58 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f9286780-a98f-4a3e-9d3b-52d55fcd8286 tempest-VolumesSnapshotTestJSON-1799736696 None] Created volume successfully. Nov 02 10:48:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e9ec1ac3-8d77-45a2-b66b-ea733684fb9d tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-57ff3918-fd24-465a-bf81-2a0975ffe207-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e9ec1ac3-8d77-45a2-b66b-ea733684fb9d tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-57ff3918-fd24-465a-bf81-2a0975ffe207-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e9ec1ac3-8d77-45a2-b66b-ea733684fb9d tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-quobyte-57ff3918-fd24-465a-bf81-2a0975ffe207" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e9ec1ac3-8d77-45a2-b66b-ea733684fb9d tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-57ff3918-fd24-465a-bf81-2a0975ffe207" acquired by "delete_volume" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:59 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[565a5f41-1ac6-46cb-aa95-b821cfa13890]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e9ec1ac3-8d77-45a2-b66b-ea733684fb9d tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-57ff3918-fd24-465a-bf81-2a0975ffe207 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:59 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-57ff3918-fd24-465a-bf81-2a0975ffe207 Nov 02 10:48:59 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:59 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e9ec1ac3-8d77-45a2-b66b-ea733684fb9d tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-57ff3918-fd24-465a-bf81-2a0975ffe207" returned: 0 in 0.477s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e9ec1ac3-8d77-45a2-b66b-ea733684fb9d tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-57ff3918-fd24-465a-bf81-2a0975ffe207 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:59 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-57ff3918-fd24-465a-bf81-2a0975ffe207 Nov 02 10:48:59 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:59 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e9ec1ac3-8d77-45a2-b66b-ea733684fb9d tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-57ff3918-fd24-465a-bf81-2a0975ffe207" returned: 0 in 0.338s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e9ec1ac3-8d77-45a2-b66b-ea733684fb9d tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-57ff3918-fd24-465a-bf81-2a0975ffe207" released by "delete_volume" :: held 0.910s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-e9ec1ac3-8d77-45a2-b66b-ea733684fb9d tempest-VolumesSnapshotTestJSON-1799736696 None] Created reservations ['70d01f51-0c8d-4339-a29d-276909f35c8e', '8ad9a8cc-a452-4aee-9459-03de3f4f9694', '32a8c46b-a49b-4593-afdd-8ef84f6ef7b4', '114a818b-4b54-42de-90c8-f88a8305e02f'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e9ec1ac3-8d77-45a2-b66b-ea733684fb9d tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e9ec1ac3-8d77-45a2-b66b-ea733684fb9d tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e9ec1ac3-8d77-45a2-b66b-ea733684fb9d tempest-VolumesSnapshotTestJSON-1799736696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e9ec1ac3-8d77-45a2-b66b-ea733684fb9d tempest-VolumesSnapshotTestJSON-1799736696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e9ec1ac3-8d77-45a2-b66b-ea733684fb9d tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e9ec1ac3-8d77-45a2-b66b-ea733684fb9d tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:00 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:49:00 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-ec0a2bc9-8041-4813-94ca-ac4e6309d618-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-ec0a2bc9-8041-4813-94ca-ac4e6309d618-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-quobyte-e7370df8-ef60-4c6e-8ce5-f03923bfab6e" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-e7370df8-ef60-4c6e-8ce5-f03923bfab6e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-quobyte-ec0a2bc9-8041-4813-94ca-ac4e6309d618" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-ec0a2bc9-8041-4813-94ca-ac4e6309d618" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] Deleting offline snapshot ec0a2bc9-8041-4813-94ca-ac4e6309d618 of volume e7370df8-ef60-4c6e-8ce5-f03923bfab6e {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] snapshot_file for this snap is: volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[47629df3-3458-44ff-9b41-c38f751e3cc9]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:00 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e9ec1ac3-8d77-45a2-b66b-ea733684fb9d tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.389s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-e9ec1ac3-8d77-45a2-b66b-ea733684fb9d tempest-VolumesSnapshotTestJSON-1799736696 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:00 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e9ec1ac3-8d77-45a2-b66b-ea733684fb9d tempest-VolumesSnapshotTestJSON-1799736696 None] Deleted volume successfully. Nov 02 10:49:00 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618 Nov 02 10:49:00 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e9ec1ac3-8d77-45a2-b66b-ea733684fb9d tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-57ff3918-fd24-465a-bf81-2a0975ffe207-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:00 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618" returned: 0 in 0.526s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaf83b4-33b9-48c5-9bc7-54c47744c0a0]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:01 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e Nov 02 10:49:01 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:01 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e" returned: 0 in 0.637s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:01 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618 Nov 02 10:49:01 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:02 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618" returned: 0 in 0.517s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:02 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618 Nov 02 10:49:02 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:02 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e.ec0a2bc9-8041-4813-94ca-ac4e6309d618" returned: 0 in 0.330s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-ec0a2bc9-8041-4813-94ca-ac4e6309d618" released by "_delete_snapshot" :: held 2.220s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-e7370df8-ef60-4c6e-8ce5-f03923bfab6e" released by "delete_snapshot" :: held 2.253s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:02 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] Created reservations ['019c844e-3c99-4de3-a76e-ffc0ca6fe8ac', '14124fa6-345b-447c-8f12-327e93e65e14', '6548835f-79f8-480f-abb0-78c4d788a682', 'e0b9001e-3c7e-42ac-a157-67626fd56550'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:02 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] Delete snapshot completed successfully. Nov 02 10:49:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6feba209-e35a-480a-b618-743cf042b3b7 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-ec0a2bc9-8041-4813-94ca-ac4e6309d618-delete_snapshot" released by "delete_snapshot" :: held 2.491s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-62fa66b3-5735-4bf5-bf33-b8154d68e432 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-e7370df8-ef60-4c6e-8ce5-f03923bfab6e-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-62fa66b3-5735-4bf5-bf33-b8154d68e432 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-e7370df8-ef60-4c6e-8ce5-f03923bfab6e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-62fa66b3-5735-4bf5-bf33-b8154d68e432 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-quobyte-e7370df8-ef60-4c6e-8ce5-f03923bfab6e" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-62fa66b3-5735-4bf5-bf33-b8154d68e432 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-e7370df8-ef60-4c6e-8ce5-f03923bfab6e" acquired by "delete_volume" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:03 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[171a9996-0c76-4703-b484-9ec56ce96773]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-62fa66b3-5735-4bf5-bf33-b8154d68e432 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:03 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e Nov 02 10:49:03 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:04 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-62fa66b3-5735-4bf5-bf33-b8154d68e432 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e" returned: 0 in 0.488s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-62fa66b3-5735-4bf5-bf33-b8154d68e432 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:04 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e Nov 02 10:49:04 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:04 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-62fa66b3-5735-4bf5-bf33-b8154d68e432 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-e7370df8-ef60-4c6e-8ce5-f03923bfab6e" returned: 0 in 0.379s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-62fa66b3-5735-4bf5-bf33-b8154d68e432 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-e7370df8-ef60-4c6e-8ce5-f03923bfab6e" released by "delete_volume" :: held 0.981s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:04 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-62fa66b3-5735-4bf5-bf33-b8154d68e432 tempest-VolumesSnapshotTestJSON-1799736696 None] Created reservations ['24543059-19df-46b5-8a6a-a959041b7e66', '187bbda4-e00b-4469-b925-a990977ca75d', '960926d8-5221-401d-b7db-3ad2ebb757c7', '8b8527ff-a6cd-49e2-8cbd-f09b924c7534'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-62fa66b3-5735-4bf5-bf33-b8154d68e432 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-62fa66b3-5735-4bf5-bf33-b8154d68e432 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-62fa66b3-5735-4bf5-bf33-b8154d68e432 tempest-VolumesSnapshotTestJSON-1799736696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-62fa66b3-5735-4bf5-bf33-b8154d68e432 tempest-VolumesSnapshotTestJSON-1799736696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-62fa66b3-5735-4bf5-bf33-b8154d68e432 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-62fa66b3-5735-4bf5-bf33-b8154d68e432 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:04 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:49:04 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:05 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-62fa66b3-5735-4bf5-bf33-b8154d68e432 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.325s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:05 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-62fa66b3-5735-4bf5-bf33-b8154d68e432 tempest-VolumesSnapshotTestJSON-1799736696 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:05 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-62fa66b3-5735-4bf5-bf33-b8154d68e432 tempest-VolumesSnapshotTestJSON-1799736696 None] Deleted volume successfully. Nov 02 10:49:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-62fa66b3-5735-4bf5-bf33-b8154d68e432 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-e7370df8-ef60-4c6e-8ce5-f03923bfab6e-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Flow 'volume_create_manager' (4b94b408-6b83-4ef8-98c1-1c66e31b1a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4270f919-3aec-47af-9ba1-03059fc55f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4270f919-3aec-47af-9ba1-03059fc55f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-871154103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8577fe2-b640-4aaf-8e75-e390ce5e162e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169ccc547bf64525ae2a8f2f0943407f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:07Z,use_quota=True,user_id='347d5bcf8db94613a831bb8af5a413c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08345c39-f200-454b-9065-4f2d032309f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08345c39-f200-454b-9065-4f2d032309f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3e87f9-236c-4621-a744-9482b378d2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3e87f9-236c-4621-a744-9482b378d2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8577fe2-b640-4aaf-8e75-e390ce5e162e', 'volume_name': 'volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ea2934-e142-4d5a-9c89-b701bd817657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ea2934-e142-4d5a-9c89-b701bd817657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (980cb086-d323-4187-8c8d-b2e3c69700fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:06 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Volume b8577fe2-b640-4aaf-8e75-e390ce5e162e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e', 'volume_size': 1} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-871154103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8577fe2-b640-4aaf-8e75-e390ce5e162e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169ccc547bf64525ae2a8f2f0943407f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:07Z,use_quota=True,user_id='347d5bcf8db94613a831bb8af5a413c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Creating volume b8577fe2-b640-4aaf-8e75-e390ce5e162e {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:49:06 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:49:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:06 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e 1073741824 Nov 02 10:49:06 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:07 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e 1073741824" returned: 0 in 0.520s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:07 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e Nov 02 10:49:07 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:07 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e" returned: 0 in 0.383s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:49:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (980cb086-d323-4187-8c8d-b2e3c69700fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf3e373-9cce-41b0-87a6-f25181d23769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:07 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Volume volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e (b8577fe2-b640-4aaf-8e75-e390ce5e162e): created successfully Nov 02 10:49:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf3e373-9cce-41b0-87a6-f25181d23769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Flow 'volume_create_manager' (4b94b408-6b83-4ef8-98c1-1c66e31b1a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:07 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-fcdf1ba7-c3e6-4462-a92a-9c8f3f02bead tempest-VolumesSnapshotTestJSON-1799736696 None] Created volume successfully. Nov 02 10:49:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-349f13ce-b575-478a-8162-68e396d2d2ff tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-349f13ce-b575-478a-8162-68e396d2d2ff tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-349f13ce-b575-478a-8162-68e396d2d2ff tempest-VolumesSnapshotTestJSON-1799736696 None] Creating offline snapshot 6d2bca98-2a94-4a46-8b92-604fcd3e4055 of volume b8577fe2-b640-4aaf-8e75-e390ce5e162e {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:49:09 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedefb81-f911-4241-a1c3-a2808d842a72]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-349f13ce-b575-478a-8162-68e396d2d2ff tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:09 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e Nov 02 10:49:09 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:09 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-349f13ce-b575-478a-8162-68e396d2d2ff tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e" returned: 0 in 0.497s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-349f13ce-b575-478a-8162-68e396d2d2ff tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:09 devstack sudo[97316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055 1G Nov 02 10:49:09 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:10 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-349f13ce-b575-478a-8162-68e396d2d2ff tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055 1G" returned: 0 in 0.542s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-349f13ce-b575-478a-8162-68e396d2d2ff tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:10 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055 Nov 02 10:49:10 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:10 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-349f13ce-b575-478a-8162-68e396d2d2ff tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055" returned: 0 in 0.371s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:10 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-349f13ce-b575-478a-8162-68e396d2d2ff tempest-VolumesSnapshotTestJSON-1799736696 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055 is being set with open permissions: ugo+rw Nov 02 10:49:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-349f13ce-b575-478a-8162-68e396d2d2ff tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:10 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055 Nov 02 10:49:10 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:10 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-349f13ce-b575-478a-8162-68e396d2d2ff tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055" returned: 0 in 0.324s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-349f13ce-b575-478a-8162-68e396d2d2ff tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:10 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.info Nov 02 10:49:10 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:11 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-349f13ce-b575-478a-8162-68e396d2d2ff tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.info" returned: 0 in 0.291s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:11 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-349f13ce-b575-478a-8162-68e396d2d2ff tempest-VolumesSnapshotTestJSON-1799736696 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.info is being set with open permissions: ugo+rw Nov 02 10:49:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-349f13ce-b575-478a-8162-68e396d2d2ff tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:11 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.info Nov 02 10:49:11 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:11 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-349f13ce-b575-478a-8162-68e396d2d2ff tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.info" returned: 0 in 0.283s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-349f13ce-b575-478a-8162-68e396d2d2ff tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.439s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:11 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-349f13ce-b575-478a-8162-68e396d2d2ff tempest-VolumesSnapshotTestJSON-1799736696 None] Create snapshot completed successfully Nov 02 10:49:12 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:49:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Flow 'volume_create_manager' (676c1119-696b-47d8-8bcb-4f328c928f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a755f9-b885-4544-a1a8-996d2e5226fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a755f9-b885-4544-a1a8-996d2e5226fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1241921578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcddf104-b088-4684-abaa-aa623aeb9f1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169ccc547bf64525ae2a8f2f0943407f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6d2bca98-2a94-4a46-8b92-604fcd3e4055,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:13Z,use_quota=True,user_id='347d5bcf8db94613a831bb8af5a413c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe84b2a-84f0-4844-807f-0b047b1140a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe84b2a-84f0-4844-807f-0b047b1140a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d58cedc7-d999-4c20-b0a9-17e866ab7c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d58cedc7-d999-4c20-b0a9-17e866ab7c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bcddf104-b088-4684-abaa-aa623aeb9f1c', 'volume_name': 'volume-bcddf104-b088-4684-abaa-aa623aeb9f1c', 'volume_size': 1, 'snapshot_id': '6d2bca98-2a94-4a46-8b92-604fcd3e4055'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3759d418-1ace-4095-bee7-4da6de0d0c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3759d418-1ace-4095-bee7-4da6de0d0c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f63fac0a-2a42-4c02-9260-ccce05b008a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:12 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Volume bcddf104-b088-4684-abaa-aa623aeb9f1c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bcddf104-b088-4684-abaa-aa623aeb9f1c', 'volume_size': 1, 'snapshot_id': '6d2bca98-2a94-4a46-8b92-604fcd3e4055'} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-quobyte-6d2bca98-2a94-4a46-8b92-604fcd3e4055-bcddf104-b088-4684-abaa-aa623aeb9f1c" by "_create_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-6d2bca98-2a94-4a46-8b92-604fcd3e4055-bcddf104-b088-4684-abaa-aa623aeb9f1c" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Creating volume bcddf104-b088-4684-abaa-aa623aeb9f1c from snapshot 6d2bca98-2a94-4a46-8b92-604fcd3e4055 {{(pid=87084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-quobyte-bcddf104-b088-4684-abaa-aa623aeb9f1c" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-bcddf104-b088-4684-abaa-aa623aeb9f1c" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] snapshot: 6d2bca98-2a94-4a46-8b92-604fcd3e4055, volume: bcddf104-b088-4684-abaa-aa623aeb9f1c, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcfde04-c6b2-436e-9f07-abb97c27f47e]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:13 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055 Nov 02 10:49:13 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:13 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055" returned: 0 in 0.479s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34d8918-1a9b-4ab8-ae6a-5cb0a10fa931]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:13 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e Nov 02 10:49:13 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:14 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e" returned: 0 in 0.488s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:49:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:49:14 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Path /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bcddf104-b088-4684-abaa-aa623aeb9f1c not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:49:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bcddf104-b088-4684-abaa-aa623aeb9f1c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:14 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bcddf104-b088-4684-abaa-aa623aeb9f1c Nov 02 10:49:14 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:22 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=20,cinder:UPDATE=29,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:49:23 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=29,cinder:UPDATE=29,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:49:23 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bcddf104-b088-4684-abaa-aa623aeb9f1c" returned: 0 in 9.801s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:23 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Image conversion details: src /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e, size 1024.00 MB, duration 9.80 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bcddf104-b088-4684-abaa-aa623aeb9f1c {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:49:23 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Converted 1024.00 MB image at 104.46 MB/s Nov 02 10:49:23 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bcddf104-b088-4684-abaa-aa623aeb9f1c is being set with open permissions: ugo+rw Nov 02 10:49:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bcddf104-b088-4684-abaa-aa623aeb9f1c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:23 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bcddf104-b088-4684-abaa-aa623aeb9f1c Nov 02 10:49:23 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:24 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bcddf104-b088-4684-abaa-aa623aeb9f1c" returned: 0 in 0.289s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-bcddf104-b088-4684-abaa-aa623aeb9f1c" released by "_copy_volume_from_snapshot" :: held 11.174s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-6d2bca98-2a94-4a46-8b92-604fcd3e4055-bcddf104-b088-4684-abaa-aa623aeb9f1c" released by "_create_volume_from_snapshot" :: held 11.258s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.282s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f63fac0a-2a42-4c02-9260-ccce05b008a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcddf104-b088-4684-abaa-aa623aeb9f1c', 'volume_size': 1, 'snapshot_id': '6d2bca98-2a94-4a46-8b92-604fcd3e4055'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674690de-8b17-4e7d-a94b-5de6a09db60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:24 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Volume volume-bcddf104-b088-4684-abaa-aa623aeb9f1c (bcddf104-b088-4684-abaa-aa623aeb9f1c): created successfully Nov 02 10:49:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674690de-8b17-4e7d-a94b-5de6a09db60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Flow 'volume_create_manager' (676c1119-696b-47d8-8bcb-4f328c928f71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:24 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5687e922-8cb4-4e4e-be1f-fd27a3f58bca tempest-VolumesSnapshotTestJSON-1799736696 None] Created volume successfully. Nov 02 10:49:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85c8009a-9909-4143-9209-e28a87e5a193 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-bcddf104-b088-4684-abaa-aa623aeb9f1c-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85c8009a-9909-4143-9209-e28a87e5a193 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-bcddf104-b088-4684-abaa-aa623aeb9f1c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85c8009a-9909-4143-9209-e28a87e5a193 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-quobyte-bcddf104-b088-4684-abaa-aa623aeb9f1c" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85c8009a-9909-4143-9209-e28a87e5a193 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-bcddf104-b088-4684-abaa-aa623aeb9f1c" acquired by "delete_volume" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:25 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20d68cc-d469-41a2-8e11-3e0983a2f945]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85c8009a-9909-4143-9209-e28a87e5a193 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bcddf104-b088-4684-abaa-aa623aeb9f1c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:25 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bcddf104-b088-4684-abaa-aa623aeb9f1c Nov 02 10:49:25 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:25 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85c8009a-9909-4143-9209-e28a87e5a193 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bcddf104-b088-4684-abaa-aa623aeb9f1c" returned: 0 in 0.510s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85c8009a-9909-4143-9209-e28a87e5a193 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bcddf104-b088-4684-abaa-aa623aeb9f1c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:25 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bcddf104-b088-4684-abaa-aa623aeb9f1c Nov 02 10:49:25 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:26 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85c8009a-9909-4143-9209-e28a87e5a193 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bcddf104-b088-4684-abaa-aa623aeb9f1c" returned: 0 in 0.457s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85c8009a-9909-4143-9209-e28a87e5a193 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-bcddf104-b088-4684-abaa-aa623aeb9f1c" released by "delete_volume" :: held 1.034s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:26 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-85c8009a-9909-4143-9209-e28a87e5a193 tempest-VolumesSnapshotTestJSON-1799736696 None] Created reservations ['d22afb63-7027-46b3-85c4-db0ecc65c941', 'b9e7a1e4-86c2-410f-8df3-e60b4ea030f7', '6e867596-9d4e-47e6-beb6-e6a3019a3eb7', 'ff2d76b6-c30c-462f-bab4-f06a77ca0702'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-85c8009a-9909-4143-9209-e28a87e5a193 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-85c8009a-9909-4143-9209-e28a87e5a193 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-85c8009a-9909-4143-9209-e28a87e5a193 tempest-VolumesSnapshotTestJSON-1799736696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-85c8009a-9909-4143-9209-e28a87e5a193 tempest-VolumesSnapshotTestJSON-1799736696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-85c8009a-9909-4143-9209-e28a87e5a193 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85c8009a-9909-4143-9209-e28a87e5a193 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:26 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:49:26 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:26 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85c8009a-9909-4143-9209-e28a87e5a193 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.334s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:26 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-85c8009a-9909-4143-9209-e28a87e5a193 tempest-VolumesSnapshotTestJSON-1799736696 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:26 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-85c8009a-9909-4143-9209-e28a87e5a193 tempest-VolumesSnapshotTestJSON-1799736696 None] Deleted volume successfully. Nov 02 10:49:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85c8009a-9909-4143-9209-e28a87e5a193 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-bcddf104-b088-4684-abaa-aa623aeb9f1c-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-6d2bca98-2a94-4a46-8b92-604fcd3e4055-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-6d2bca98-2a94-4a46-8b92-604fcd3e4055-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-quobyte-b8577fe2-b640-4aaf-8e75-e390ce5e162e" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-b8577fe2-b640-4aaf-8e75-e390ce5e162e" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-quobyte-6d2bca98-2a94-4a46-8b92-604fcd3e4055" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-6d2bca98-2a94-4a46-8b92-604fcd3e4055" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] Deleting offline snapshot 6d2bca98-2a94-4a46-8b92-604fcd3e4055 of volume b8577fe2-b640-4aaf-8e75-e390ce5e162e {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:49:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] snapshot_file for this snap is: volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:49:28 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d64a7a2-0fd3-4089-b8df-89163431126c]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:28 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055 Nov 02 10:49:28 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:28 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055" returned: 0 in 0.650s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:49:28 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[419df443-cc19-4ccc-ad4a-e134859b92a6]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:29 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e Nov 02 10:49:29 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:29 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e" returned: 0 in 1.196s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:30 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055 Nov 02 10:49:30 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:30 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055" returned: 0 in 0.694s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:30 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055 Nov 02 10:49:30 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:31 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e.6d2bca98-2a94-4a46-8b92-604fcd3e4055" returned: 0 in 0.395s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-6d2bca98-2a94-4a46-8b92-604fcd3e4055" released by "_delete_snapshot" :: held 3.183s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-b8577fe2-b640-4aaf-8e75-e390ce5e162e" released by "delete_snapshot" :: held 3.231s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:31 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] Created reservations ['3af05db8-f116-4dbd-96c9-5dc5bb950005', 'e813e0d0-9490-4610-9397-5b8bda302171', '8f7183ef-e175-4997-99e7-23fb8c80d29f', '5d9ce97a-4e2b-4954-9fab-c32f78b6e0b3'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] Delete snapshot completed successfully. Nov 02 10:49:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3e7bba75-8e9d-4430-ad5b-678adfebf93d tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-6d2bca98-2a94-4a46-8b92-604fcd3e4055-delete_snapshot" released by "delete_snapshot" :: held 3.513s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-78416470-a0e4-416c-a502-5c5cdbda0413 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-b8577fe2-b640-4aaf-8e75-e390ce5e162e-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-78416470-a0e4-416c-a502-5c5cdbda0413 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-b8577fe2-b640-4aaf-8e75-e390ce5e162e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-78416470-a0e4-416c-a502-5c5cdbda0413 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-quobyte-b8577fe2-b640-4aaf-8e75-e390ce5e162e" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Flow 'volume_create_manager' (f27fa35d-6ec6-411f-81fe-1a9df03b9160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (176fce3e-3ddc-4e1a-b01b-c3dfcc8350f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-78416470-a0e4-416c-a502-5c5cdbda0413 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-b8577fe2-b640-4aaf-8e75-e390ce5e162e" acquired by "delete_volume" :: waited 0.105s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (176fce3e-3ddc-4e1a-b01b-c3dfcc8350f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1384465946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54f73e9-5e22-47c2-8859-20bb23ba4ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aed18ca480d4fb3a767445a6025637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:33Z,use_quota=True,user_id='fd6f62aa31b7493b8e62b823c2b23481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e3110db-6e6b-4954-a9d6-ea445a529e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e3110db-6e6b-4954-a9d6-ea445a529e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37119ed0-789f-4898-ad5b-30181db9c2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37119ed0-789f-4898-ad5b-30181db9c2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54f73e9-5e22-47c2-8859-20bb23ba4ca8', 'volume_name': 'volume-b54f73e9-5e22-47c2-8859-20bb23ba4ca8', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57be4ec4-8be8-4379-a9dc-7c54f5ce1c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57be4ec4-8be8-4379-a9dc-7c54f5ce1c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e5ed7e-feb5-43dc-9064-4f5f04f8aa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:32 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Volume b54f73e9-5e22-47c2-8859-20bb23ba4ca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54f73e9-5e22-47c2-8859-20bb23ba4ca8', 'volume_size': 1} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1384465946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54f73e9-5e22-47c2-8859-20bb23ba4ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aed18ca480d4fb3a767445a6025637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:33Z,use_quota=True,user_id='fd6f62aa31b7493b8e62b823c2b23481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Creating volume b54f73e9-5e22-47c2-8859-20bb23ba4ca8 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:49:32 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:49:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b54f73e9-5e22-47c2-8859-20bb23ba4ca8 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:33 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[07851f2e-75b5-4ae3-8104-ff1329526b3d]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-78416470-a0e4-416c-a502-5c5cdbda0413 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:33 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b54f73e9-5e22-47c2-8859-20bb23ba4ca8 1073741824 Nov 02 10:49:33 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:33 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e Nov 02 10:49:33 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:33 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b54f73e9-5e22-47c2-8859-20bb23ba4ca8 1073741824" returned: 0 in 0.663s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:33 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-78416470-a0e4-416c-a502-5c5cdbda0413 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e" returned: 0 in 0.699s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-78416470-a0e4-416c-a502-5c5cdbda0413 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b54f73e9-5e22-47c2-8859-20bb23ba4ca8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:33 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b54f73e9-5e22-47c2-8859-20bb23ba4ca8 Nov 02 10:49:33 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:33 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e Nov 02 10:49:33 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:34 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b54f73e9-5e22-47c2-8859-20bb23ba4ca8" returned: 0 in 0.320s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e5ed7e-feb5-43dc-9064-4f5f04f8aa14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54f73e9-5e22-47c2-8859-20bb23ba4ca8', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9646832f-1033-4eb6-9924-2313ae888161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:34 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Volume volume-b54f73e9-5e22-47c2-8859-20bb23ba4ca8 (b54f73e9-5e22-47c2-8859-20bb23ba4ca8): created successfully Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9646832f-1033-4eb6-9924-2313ae888161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Flow 'volume_create_manager' (f27fa35d-6ec6-411f-81fe-1a9df03b9160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:34 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-78416470-a0e4-416c-a502-5c5cdbda0413 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8577fe2-b640-4aaf-8e75-e390ce5e162e" returned: 0 in 0.447s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f81bdffd-5293-4fb4-a0a1-853b98ed1233 tempest-VolumesActionsTest-1580589606 None] Created volume successfully. Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-78416470-a0e4-416c-a502-5c5cdbda0413 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-b8577fe2-b640-4aaf-8e75-e390ce5e162e" released by "delete_volume" :: held 1.384s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-78416470-a0e4-416c-a502-5c5cdbda0413 tempest-VolumesSnapshotTestJSON-1799736696 None] Created reservations ['a55fe9ad-dc7a-4be2-ae38-835dca6f6d04', '613c620a-b9c4-4f30-90c0-22d509b8a63b', '09809bf9-4818-471f-82be-d182595f88ed', 'c3f5254f-4910-4b01-ad13-8f04d71d1403'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-78416470-a0e4-416c-a502-5c5cdbda0413 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-78416470-a0e4-416c-a502-5c5cdbda0413 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-78416470-a0e4-416c-a502-5c5cdbda0413 tempest-VolumesSnapshotTestJSON-1799736696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-78416470-a0e4-416c-a502-5c5cdbda0413 tempest-VolumesSnapshotTestJSON-1799736696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-78416470-a0e4-416c-a502-5c5cdbda0413 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-78416470-a0e4-416c-a502-5c5cdbda0413 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:34 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:49:34 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:34 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-78416470-a0e4-416c-a502-5c5cdbda0413 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.402s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-78416470-a0e4-416c-a502-5c5cdbda0413 tempest-VolumesSnapshotTestJSON-1799736696 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-65e1b7ce-0387-408b-a3cc-94a7f9998837 tempest-VolumesActionsTest-1580589606 None] Acquiring lock "cinder-b54f73e9-5e22-47c2-8859-20bb23ba4ca8" by "attach_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-78416470-a0e4-416c-a502-5c5cdbda0413 tempest-VolumesSnapshotTestJSON-1799736696 None] Deleted volume successfully. Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-65e1b7ce-0387-408b-a3cc-94a7f9998837 tempest-VolumesActionsTest-1580589606 None] Lock "cinder-b54f73e9-5e22-47c2-8859-20bb23ba4ca8" acquired by "attach_volume" :: waited 0.064s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-78416470-a0e4-416c-a502-5c5cdbda0413 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-b8577fe2-b640-4aaf-8e75-e390ce5e162e-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-65e1b7ce-0387-408b-a3cc-94a7f9998837 tempest-VolumesActionsTest-1580589606 None] Attaching volume b54f73e9-5e22-47c2-8859-20bb23ba4ca8 to instance 77bc537f-b3a9-4a11-8a15-7aa56f1fee3e at mountpoint /dev/vdb on host None. Nov 02 10:49:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-65e1b7ce-0387-408b-a3cc-94a7f9998837 tempest-VolumesActionsTest-1580589606 None] Attach volume completed successfully. Nov 02 10:49:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-65e1b7ce-0387-408b-a3cc-94a7f9998837 tempest-VolumesActionsTest-1580589606 None] Lock "cinder-b54f73e9-5e22-47c2-8859-20bb23ba4ca8" released by "attach_volume" :: held 0.145s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5dc958d7-d4f7-4be7-8a45-24d11a190f65 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-bf4085ca-6ca7-46d2-b9e8-637359adaed1-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5dc958d7-d4f7-4be7-8a45-24d11a190f65 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-bf4085ca-6ca7-46d2-b9e8-637359adaed1-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5dc958d7-d4f7-4be7-8a45-24d11a190f65 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "cinder-quobyte-bf4085ca-6ca7-46d2-b9e8-637359adaed1" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5dc958d7-d4f7-4be7-8a45-24d11a190f65 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-bf4085ca-6ca7-46d2-b9e8-637359adaed1" acquired by "delete_volume" :: waited 0.038s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:35 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e575695f-80ce-4e81-92f9-753d80a3cc47]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dc958d7-d4f7-4be7-8a45-24d11a190f65 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:35 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1 Nov 02 10:49:35 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:36 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dc958d7-d4f7-4be7-8a45-24d11a190f65 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1" returned: 0 in 0.571s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dc958d7-d4f7-4be7-8a45-24d11a190f65 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:36 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1 Nov 02 10:49:36 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:36 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dc958d7-d4f7-4be7-8a45-24d11a190f65 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bf4085ca-6ca7-46d2-b9e8-637359adaed1" returned: 0 in 0.496s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5dc958d7-d4f7-4be7-8a45-24d11a190f65 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-quobyte-bf4085ca-6ca7-46d2-b9e8-637359adaed1" released by "delete_volume" :: held 1.224s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:36 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-5dc958d7-d4f7-4be7-8a45-24d11a190f65 tempest-VolumesSnapshotTestJSON-1799736696 None] Created reservations ['47d5efbd-f170-418f-a0bf-3e1f471c34d2', 'ed72fd48-2f69-4a0c-82ba-628a991cc77f', '5209c3e0-4b34-45ff-9f16-2700965a0c8a', '66659021-5b33-4901-a0f2-5e2b652e8738'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:36 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2cf27452-ca92-41c2-824f-1e35a880ec21 tempest-VolumesActionsTest-301136523 None] Terminate volume connection completed successfully. Nov 02 10:49:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5dc958d7-d4f7-4be7-8a45-24d11a190f65 tempest-VolumesSnapshotTestJSON-1799736696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5dc958d7-d4f7-4be7-8a45-24d11a190f65 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5dc958d7-d4f7-4be7-8a45-24d11a190f65 tempest-VolumesSnapshotTestJSON-1799736696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5dc958d7-d4f7-4be7-8a45-24d11a190f65 tempest-VolumesSnapshotTestJSON-1799736696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5dc958d7-d4f7-4be7-8a45-24d11a190f65 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dc958d7-d4f7-4be7-8a45-24d11a190f65 tempest-VolumesSnapshotTestJSON-1799736696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2cf27452-ca92-41c2-824f-1e35a880ec21 tempest-VolumesActionsTest-301136523 None] Acquiring lock "cinder-b54f73e9-5e22-47c2-8859-20bb23ba4ca8-detach_volume" by "detach_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:36 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:49:36 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2cf27452-ca92-41c2-824f-1e35a880ec21 tempest-VolumesActionsTest-301136523 None] Lock "cinder-b54f73e9-5e22-47c2-8859-20bb23ba4ca8-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2cf27452-ca92-41c2-824f-1e35a880ec21 tempest-VolumesActionsTest-301136523 None] Detaching volume b54f73e9-5e22-47c2-8859-20bb23ba4ca8 from instance 77bc537f-b3a9-4a11-8a15-7aa56f1fee3e. Nov 02 10:49:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2cf27452-ca92-41c2-824f-1e35a880ec21 tempest-VolumesActionsTest-301136523 None] Detach volume completed successfully. Nov 02 10:49:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2cf27452-ca92-41c2-824f-1e35a880ec21 tempest-VolumesActionsTest-301136523 None] Lock "cinder-b54f73e9-5e22-47c2-8859-20bb23ba4ca8-detach_volume" released by "detach_volume" :: held 0.149s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:37 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dc958d7-d4f7-4be7-8a45-24d11a190f65 tempest-VolumesSnapshotTestJSON-1799736696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.554s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:37 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-5dc958d7-d4f7-4be7-8a45-24d11a190f65 tempest-VolumesSnapshotTestJSON-1799736696 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5dc958d7-d4f7-4be7-8a45-24d11a190f65 tempest-VolumesSnapshotTestJSON-1799736696 None] Deleted volume successfully. Nov 02 10:49:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5dc958d7-d4f7-4be7-8a45-24d11a190f65 tempest-VolumesSnapshotTestJSON-1799736696 None] Lock "cinder-bf4085ca-6ca7-46d2-b9e8-637359adaed1-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bc9a22ac-7b55-4400-8148-e78af7445a55 tempest-VolumesActionsTest-1580589606 None] Acquiring lock "cinder-b54f73e9-5e22-47c2-8859-20bb23ba4ca8-detach_volume" by "detach_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bc9a22ac-7b55-4400-8148-e78af7445a55 tempest-VolumesActionsTest-1580589606 None] Lock "cinder-b54f73e9-5e22-47c2-8859-20bb23ba4ca8-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-bc9a22ac-7b55-4400-8148-e78af7445a55 tempest-VolumesActionsTest-1580589606 None] Volume detach called, but volume not attached. Nov 02 10:49:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bc9a22ac-7b55-4400-8148-e78af7445a55 tempest-VolumesActionsTest-1580589606 None] Lock "cinder-b54f73e9-5e22-47c2-8859-20bb23ba4ca8-detach_volume" released by "detach_volume" :: held 0.048s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7b51bb85-cc91-4fb3-9c65-af804e6406fa tempest-VolumesActionsTest-1580589606 None] Acquiring lock "cinder-b54f73e9-5e22-47c2-8859-20bb23ba4ca8-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7b51bb85-cc91-4fb3-9c65-af804e6406fa tempest-VolumesActionsTest-1580589606 None] Lock "cinder-b54f73e9-5e22-47c2-8859-20bb23ba4ca8-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7b51bb85-cc91-4fb3-9c65-af804e6406fa tempest-VolumesActionsTest-1580589606 None] Acquiring lock "cinder-quobyte-b54f73e9-5e22-47c2-8859-20bb23ba4ca8" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7b51bb85-cc91-4fb3-9c65-af804e6406fa tempest-VolumesActionsTest-1580589606 None] Lock "cinder-quobyte-b54f73e9-5e22-47c2-8859-20bb23ba4ca8" acquired by "delete_volume" :: waited 0.039s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:38 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[923b9bd2-6167-4c10-86bd-b00a64a51544]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7b51bb85-cc91-4fb3-9c65-af804e6406fa tempest-VolumesActionsTest-1580589606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b54f73e9-5e22-47c2-8859-20bb23ba4ca8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:38 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b54f73e9-5e22-47c2-8859-20bb23ba4ca8 Nov 02 10:49:38 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:39 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7b51bb85-cc91-4fb3-9c65-af804e6406fa tempest-VolumesActionsTest-1580589606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b54f73e9-5e22-47c2-8859-20bb23ba4ca8" returned: 0 in 0.966s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7b51bb85-cc91-4fb3-9c65-af804e6406fa tempest-VolumesActionsTest-1580589606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b54f73e9-5e22-47c2-8859-20bb23ba4ca8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:39 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b54f73e9-5e22-47c2-8859-20bb23ba4ca8 Nov 02 10:49:39 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:39 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7b51bb85-cc91-4fb3-9c65-af804e6406fa tempest-VolumesActionsTest-1580589606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b54f73e9-5e22-47c2-8859-20bb23ba4ca8" returned: 0 in 0.460s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7b51bb85-cc91-4fb3-9c65-af804e6406fa tempest-VolumesActionsTest-1580589606 None] Lock "cinder-quobyte-b54f73e9-5e22-47c2-8859-20bb23ba4ca8" released by "delete_volume" :: held 1.508s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:39 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-7b51bb85-cc91-4fb3-9c65-af804e6406fa tempest-VolumesActionsTest-1580589606 None] Created reservations ['5711bfba-ddae-42fc-be11-0bff746cac03', 'bd71d4bb-4a35-472c-9b7b-e1d17c1500d3', '0b832fb8-2969-43e1-a212-86dcf430f08a', 'f72f8e52-9784-4a9c-bb52-994bf86c9ad0'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7b51bb85-cc91-4fb3-9c65-af804e6406fa tempest-VolumesActionsTest-1580589606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7b51bb85-cc91-4fb3-9c65-af804e6406fa tempest-VolumesActionsTest-1580589606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7b51bb85-cc91-4fb3-9c65-af804e6406fa tempest-VolumesActionsTest-1580589606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7b51bb85-cc91-4fb3-9c65-af804e6406fa tempest-VolumesActionsTest-1580589606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7b51bb85-cc91-4fb3-9c65-af804e6406fa tempest-VolumesActionsTest-1580589606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7b51bb85-cc91-4fb3-9c65-af804e6406fa tempest-VolumesActionsTest-1580589606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:40 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:49:40 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:40 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7b51bb85-cc91-4fb3-9c65-af804e6406fa tempest-VolumesActionsTest-1580589606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.500s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:40 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-7b51bb85-cc91-4fb3-9c65-af804e6406fa tempest-VolumesActionsTest-1580589606 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:40 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7b51bb85-cc91-4fb3-9c65-af804e6406fa tempest-VolumesActionsTest-1580589606 None] Deleted volume successfully. Nov 02 10:49:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7b51bb85-cc91-4fb3-9c65-af804e6406fa tempest-VolumesActionsTest-1580589606 None] Lock "cinder-b54f73e9-5e22-47c2-8859-20bb23ba4ca8-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Flow 'volume_create_manager' (7142b40e-7035-4a04-82ae-8ce23991b658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf8dc27-4edc-4c01-bf6c-ee17d824959e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf8dc27-4edc-4c01-bf6c-ee17d824959e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-459207470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa624a1-5ea4-4607-8650-82ac1ed3768f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aed18ca480d4fb3a767445a6025637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:47Z,use_quota=True,user_id='fd6f62aa31b7493b8e62b823c2b23481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a55500b-1c1a-4d3a-ab67-0481ab85e72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a55500b-1c1a-4d3a-ab67-0481ab85e72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43f1693-5790-44ce-93c9-f40b406ceef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43f1693-5790-44ce-93c9-f40b406ceef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fa624a1-5ea4-4607-8650-82ac1ed3768f', 'volume_name': 'volume-8fa624a1-5ea4-4607-8650-82ac1ed3768f', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176af4c3-c37f-4e94-a21a-22c72ac4be9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176af4c3-c37f-4e94-a21a-22c72ac4be9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0696fbe8-adae-4a69-9b44-dd39eb248eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:46 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Volume 8fa624a1-5ea4-4607-8650-82ac1ed3768f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fa624a1-5ea4-4607-8650-82ac1ed3768f', 'volume_size': 1} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-459207470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa624a1-5ea4-4607-8650-82ac1ed3768f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aed18ca480d4fb3a767445a6025637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:47Z,use_quota=True,user_id='fd6f62aa31b7493b8e62b823c2b23481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Creating volume 8fa624a1-5ea4-4607-8650-82ac1ed3768f {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:49:46 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:49:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8fa624a1-5ea4-4607-8650-82ac1ed3768f 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:47 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8fa624a1-5ea4-4607-8650-82ac1ed3768f 1073741824 Nov 02 10:49:47 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:47 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8fa624a1-5ea4-4607-8650-82ac1ed3768f 1073741824" returned: 0 in 0.962s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8fa624a1-5ea4-4607-8650-82ac1ed3768f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:48 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8fa624a1-5ea4-4607-8650-82ac1ed3768f Nov 02 10:49:48 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:48 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8fa624a1-5ea4-4607-8650-82ac1ed3768f" returned: 0 in 0.609s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:49:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0696fbe8-adae-4a69-9b44-dd39eb248eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fa624a1-5ea4-4607-8650-82ac1ed3768f', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8903261c-00c5-4c61-9ad5-82666ad17781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:48 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Volume volume-8fa624a1-5ea4-4607-8650-82ac1ed3768f (8fa624a1-5ea4-4607-8650-82ac1ed3768f): created successfully Nov 02 10:49:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8903261c-00c5-4c61-9ad5-82666ad17781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Flow 'volume_create_manager' (7142b40e-7035-4a04-82ae-8ce23991b658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-10ee89a0-ed46-46c5-9b3c-1013b275ffbc tempest-VolumesActionsTest-1580589606 None] Created volume successfully. Nov 02 10:49:49 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:49:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Flow 'volume_create_manager' (11a8683a-7552-4f8b-9f92-f8096a7374a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade0e6b1-3395-4f28-9f4e-aa9edbd107e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade0e6b1-3395-4f28-9f4e-aa9edbd107e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1447064426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b68e8ad-6e64-4a37-bf7e-a86114b903ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d53a4fb26843baa2f9b7caedd57693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:50Z,use_quota=True,user_id='9f4bf29b1b0a489b8b75e8d5c5057fff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c4386c-3243-4134-bad3-57cc5e5739ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c4386c-3243-4134-bad3-57cc5e5739ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e4c72f-9acf-4270-ba0d-e51371071806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e4c72f-9acf-4270-ba0d-e51371071806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b68e8ad-6e64-4a37-bf7e-a86114b903ca', 'volume_name': 'volume-2b68e8ad-6e64-4a37-bf7e-a86114b903ca', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15c71c5-adf8-4194-b733-67081daed661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15c71c5-adf8-4194-b733-67081daed661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096320bf-dee3-472d-84f6-31489038f179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:50 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Volume 2b68e8ad-6e64-4a37-bf7e-a86114b903ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b68e8ad-6e64-4a37-bf7e-a86114b903ca', 'volume_size': 1} Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1447064426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b68e8ad-6e64-4a37-bf7e-a86114b903ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d53a4fb26843baa2f9b7caedd57693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:50Z,use_quota=True,user_id='9f4bf29b1b0a489b8b75e8d5c5057fff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Creating volume 2b68e8ad-6e64-4a37-bf7e-a86114b903ca {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:49:50 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2b68e8ad-6e64-4a37-bf7e-a86114b903ca 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:50 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2b68e8ad-6e64-4a37-bf7e-a86114b903ca 1073741824 Nov 02 10:49:50 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8b2f589a-f798-4028-86d2-0db8763fdbe8 tempest-VolumesActionsTest-301136523 None] Acquiring lock "cinder-8fa624a1-5ea4-4607-8650-82ac1ed3768f-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8b2f589a-f798-4028-86d2-0db8763fdbe8 tempest-VolumesActionsTest-301136523 None] Lock "cinder-8fa624a1-5ea4-4607-8650-82ac1ed3768f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8b2f589a-f798-4028-86d2-0db8763fdbe8 tempest-VolumesActionsTest-301136523 None] Acquiring lock "cinder-quobyte-8fa624a1-5ea4-4607-8650-82ac1ed3768f" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8b2f589a-f798-4028-86d2-0db8763fdbe8 tempest-VolumesActionsTest-301136523 None] Lock "cinder-quobyte-8fa624a1-5ea4-4607-8650-82ac1ed3768f" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[959e18d4-ff39-442a-908f-eee517d64a77]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8b2f589a-f798-4028-86d2-0db8763fdbe8 tempest-VolumesActionsTest-301136523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8fa624a1-5ea4-4607-8650-82ac1ed3768f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:50 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8fa624a1-5ea4-4607-8650-82ac1ed3768f Nov 02 10:49:50 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:50 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2b68e8ad-6e64-4a37-bf7e-a86114b903ca 1073741824" returned: 0 in 0.835s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2b68e8ad-6e64-4a37-bf7e-a86114b903ca {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:50 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8b2f589a-f798-4028-86d2-0db8763fdbe8 tempest-VolumesActionsTest-301136523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8fa624a1-5ea4-4607-8650-82ac1ed3768f" returned: 0 in 0.648s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8b2f589a-f798-4028-86d2-0db8763fdbe8 tempest-VolumesActionsTest-301136523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8fa624a1-5ea4-4607-8650-82ac1ed3768f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:50 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2b68e8ad-6e64-4a37-bf7e-a86114b903ca Nov 02 10:49:50 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:51 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8fa624a1-5ea4-4607-8650-82ac1ed3768f Nov 02 10:49:51 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:51 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2b68e8ad-6e64-4a37-bf7e-a86114b903ca" returned: 0 in 0.496s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:49:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096320bf-dee3-472d-84f6-31489038f179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b68e8ad-6e64-4a37-bf7e-a86114b903ca', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9354247f-ba1e-4dec-8bab-b159547ae549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:51 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Volume volume-2b68e8ad-6e64-4a37-bf7e-a86114b903ca (2b68e8ad-6e64-4a37-bf7e-a86114b903ca): created successfully Nov 02 10:49:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9354247f-ba1e-4dec-8bab-b159547ae549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Flow 'volume_create_manager' (11a8683a-7552-4f8b-9f92-f8096a7374a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:51 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6159eaa6-9921-4b2c-8c47-4c01c009cbda tempest-TestMinimumBasicScenario-893084461 None] Created volume successfully. Nov 02 10:49:51 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8b2f589a-f798-4028-86d2-0db8763fdbe8 tempest-VolumesActionsTest-301136523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8fa624a1-5ea4-4607-8650-82ac1ed3768f" returned: 0 in 0.666s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8b2f589a-f798-4028-86d2-0db8763fdbe8 tempest-VolumesActionsTest-301136523 None] Lock "cinder-quobyte-8fa624a1-5ea4-4607-8650-82ac1ed3768f" released by "delete_volume" :: held 1.413s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:51 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-8b2f589a-f798-4028-86d2-0db8763fdbe8 tempest-VolumesActionsTest-301136523 None] Created reservations ['2c29bb6b-3b8d-4475-af88-4747a6330440', '20d860ea-f83c-4909-bbab-37f88cab131a', '5416fd9f-a1ab-41c1-bccc-44348f4c655f', 'f8c43190-01dc-424d-bcac-82ae17e94503'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8b2f589a-f798-4028-86d2-0db8763fdbe8 tempest-VolumesActionsTest-301136523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8b2f589a-f798-4028-86d2-0db8763fdbe8 tempest-VolumesActionsTest-301136523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8b2f589a-f798-4028-86d2-0db8763fdbe8 tempest-VolumesActionsTest-301136523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8b2f589a-f798-4028-86d2-0db8763fdbe8 tempest-VolumesActionsTest-301136523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8b2f589a-f798-4028-86d2-0db8763fdbe8 tempest-VolumesActionsTest-301136523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8b2f589a-f798-4028-86d2-0db8763fdbe8 tempest-VolumesActionsTest-301136523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:51 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:49:51 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:52 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8b2f589a-f798-4028-86d2-0db8763fdbe8 tempest-VolumesActionsTest-301136523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.401s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:52 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-8b2f589a-f798-4028-86d2-0db8763fdbe8 tempest-VolumesActionsTest-301136523 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:52 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8b2f589a-f798-4028-86d2-0db8763fdbe8 tempest-VolumesActionsTest-301136523 None] Deleted volume successfully. Nov 02 10:49:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8b2f589a-f798-4028-86d2-0db8763fdbe8 tempest-VolumesActionsTest-301136523 None] Lock "cinder-8fa624a1-5ea4-4607-8650-82ac1ed3768f-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:53 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:49:53 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:53 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.540s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Flow 'volume_create_manager' (00f2173c-cf2a-43d0-9d48-ac4374ce2493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015f8cd3-b839-4a0f-85a5-4dd6d1cd5224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015f8cd3-b839-4a0f-85a5-4dd6d1cd5224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1007497583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c0b393-1dba-4640-be36-343ccf5fd9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aed18ca480d4fb3a767445a6025637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:54Z,use_quota=True,user_id='fd6f62aa31b7493b8e62b823c2b23481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b111b2ec-c184-4d2d-a974-6abcbd1084da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b111b2ec-c184-4d2d-a974-6abcbd1084da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (828454b0-8585-4fb4-9402-8b346b787091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (828454b0-8585-4fb4-9402-8b346b787091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44c0b393-1dba-4640-be36-343ccf5fd9ba', 'volume_name': 'volume-44c0b393-1dba-4640-be36-343ccf5fd9ba', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd24d52-f865-4613-b967-bf9dc7bbc4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd24d52-f865-4613-b967-bf9dc7bbc4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a63fdbb-0f64-4e2a-beee-b563c0e02061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:53 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Volume 44c0b393-1dba-4640-be36-343ccf5fd9ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44c0b393-1dba-4640-be36-343ccf5fd9ba', 'volume_size': 1} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1007497583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c0b393-1dba-4640-be36-343ccf5fd9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aed18ca480d4fb3a767445a6025637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:54Z,use_quota=True,user_id='fd6f62aa31b7493b8e62b823c2b23481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Creating volume 44c0b393-1dba-4640-be36-343ccf5fd9ba {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:49:53 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:49:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-44c0b393-1dba-4640-be36-343ccf5fd9ba 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:54 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-44c0b393-1dba-4640-be36-343ccf5fd9ba 1073741824 Nov 02 10:49:54 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-a9a8e286-fbb6-4b36-b251-4a12087e2e9e req-7366201f-0bed-4d13-8169-e73e15d7666b tempest-TestMinimumBasicScenario-893084461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:54 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-44c0b393-1dba-4640-be36-343ccf5fd9ba 1073741824" returned: 0 in 0.675s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-44c0b393-1dba-4640-be36-343ccf5fd9ba {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:54 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-44c0b393-1dba-4640-be36-343ccf5fd9ba Nov 02 10:49:54 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:55 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-44c0b393-1dba-4640-be36-343ccf5fd9ba" returned: 0 in 0.491s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:49:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-a9a8e286-fbb6-4b36-b251-4a12087e2e9e req-7366201f-0bed-4d13-8169-e73e15d7666b tempest-TestMinimumBasicScenario-893084461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.644s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-a9a8e286-fbb6-4b36-b251-4a12087e2e9e req-7366201f-0bed-4d13-8169-e73e15d7666b tempest-TestMinimumBasicScenario-893084461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a63fdbb-0f64-4e2a-beee-b563c0e02061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44c0b393-1dba-4640-be36-343ccf5fd9ba', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45028d65-4452-4afd-833c-679276335641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:55 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Volume volume-44c0b393-1dba-4640-be36-343ccf5fd9ba (44c0b393-1dba-4640-be36-343ccf5fd9ba): created successfully Nov 02 10:49:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45028d65-4452-4afd-833c-679276335641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Flow 'volume_create_manager' (00f2173c-cf2a-43d0-9d48-ac4374ce2493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:55 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-12b228ce-f998-41b5-8ee8-d965cc1d48c7 tempest-VolumesActionsTest-1580589606 None] Created volume successfully. Nov 02 10:49:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-a9a8e286-fbb6-4b36-b251-4a12087e2e9e req-7366201f-0bed-4d13-8169-e73e15d7666b tempest-TestMinimumBasicScenario-893084461 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-2b68e8ad-6e64-4a37-bf7e-a86114b903ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c69d50ed-f716-4e38-9c20-6784b21d2be4', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:49:55 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-a9a8e286-fbb6-4b36-b251-4a12087e2e9e req-7366201f-0bed-4d13-8169-e73e15d7666b tempest-TestMinimumBasicScenario-893084461 None] attachment_update completed successfully. Nov 02 10:49:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5e78a005-aa8f-4cfb-ab75-17c06f049113 tempest-VolumesActionsTest-301136523 None] Acquiring lock "cinder-44c0b393-1dba-4640-be36-343ccf5fd9ba-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5e78a005-aa8f-4cfb-ab75-17c06f049113 tempest-VolumesActionsTest-301136523 None] Lock "cinder-44c0b393-1dba-4640-be36-343ccf5fd9ba-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5e78a005-aa8f-4cfb-ab75-17c06f049113 tempest-VolumesActionsTest-301136523 None] Acquiring lock "cinder-quobyte-44c0b393-1dba-4640-be36-343ccf5fd9ba" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5e78a005-aa8f-4cfb-ab75-17c06f049113 tempest-VolumesActionsTest-301136523 None] Lock "cinder-quobyte-44c0b393-1dba-4640-be36-343ccf5fd9ba" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:56 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4114a94-1716-4795-bb0c-0ca38ca1c79f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5e78a005-aa8f-4cfb-ab75-17c06f049113 tempest-VolumesActionsTest-301136523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-44c0b393-1dba-4640-be36-343ccf5fd9ba {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:56 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-44c0b393-1dba-4640-be36-343ccf5fd9ba Nov 02 10:49:56 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:57 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5e78a005-aa8f-4cfb-ab75-17c06f049113 tempest-VolumesActionsTest-301136523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-44c0b393-1dba-4640-be36-343ccf5fd9ba" returned: 0 in 0.553s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5e78a005-aa8f-4cfb-ab75-17c06f049113 tempest-VolumesActionsTest-301136523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-44c0b393-1dba-4640-be36-343ccf5fd9ba {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:57 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-44c0b393-1dba-4640-be36-343ccf5fd9ba Nov 02 10:49:57 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:57 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5e78a005-aa8f-4cfb-ab75-17c06f049113 tempest-VolumesActionsTest-301136523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-44c0b393-1dba-4640-be36-343ccf5fd9ba" returned: 0 in 0.565s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5e78a005-aa8f-4cfb-ab75-17c06f049113 tempest-VolumesActionsTest-301136523 None] Lock "cinder-quobyte-44c0b393-1dba-4640-be36-343ccf5fd9ba" released by "delete_volume" :: held 1.202s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:57 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-5e78a005-aa8f-4cfb-ab75-17c06f049113 tempest-VolumesActionsTest-301136523 None] Created reservations ['f5efe9d2-b4dc-44f5-a108-258dffdc0a29', '5bca9ec9-6515-4dba-a6f6-eafec3fef83f', 'd2f73340-49a4-4b03-a389-66910cfe5379', 'a08ff7b8-cad4-454c-b656-b0a6376ad7cb'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5e78a005-aa8f-4cfb-ab75-17c06f049113 tempest-VolumesActionsTest-301136523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5e78a005-aa8f-4cfb-ab75-17c06f049113 tempest-VolumesActionsTest-301136523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5e78a005-aa8f-4cfb-ab75-17c06f049113 tempest-VolumesActionsTest-301136523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5e78a005-aa8f-4cfb-ab75-17c06f049113 tempest-VolumesActionsTest-301136523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5e78a005-aa8f-4cfb-ab75-17c06f049113 tempest-VolumesActionsTest-301136523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5e78a005-aa8f-4cfb-ab75-17c06f049113 tempest-VolumesActionsTest-301136523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:58 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:49:58 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:58 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5e78a005-aa8f-4cfb-ab75-17c06f049113 tempest-VolumesActionsTest-301136523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.467s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:58 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-5e78a005-aa8f-4cfb-ab75-17c06f049113 tempest-VolumesActionsTest-301136523 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:58 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5e78a005-aa8f-4cfb-ab75-17c06f049113 tempest-VolumesActionsTest-301136523 None] Deleted volume successfully. Nov 02 10:49:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5e78a005-aa8f-4cfb-ab75-17c06f049113 tempest-VolumesActionsTest-301136523 None] Lock "cinder-44c0b393-1dba-4640-be36-343ccf5fd9ba-delete_volume" released by "delete_volume" :: held 2.161s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Flow 'volume_create_manager' (8e8be079-f730-476b-acb9-983103091a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65afb247-5029-4468-a60e-78cb0eac31a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65afb247-5029-4468-a60e-78cb0eac31a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-680139226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a540af9a-b640-4d53-9b52-0c4d8bf572b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aed18ca480d4fb3a767445a6025637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:00Z,use_quota=True,user_id='fd6f62aa31b7493b8e62b823c2b23481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6aa9c31-127a-4fad-9c07-0cc7b0d6ea93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6aa9c31-127a-4fad-9c07-0cc7b0d6ea93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e41aab6-36ee-48fc-a57a-4315408f99b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e41aab6-36ee-48fc-a57a-4315408f99b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a540af9a-b640-4d53-9b52-0c4d8bf572b0', 'volume_name': 'volume-a540af9a-b640-4d53-9b52-0c4d8bf572b0', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8436f92a-7377-4767-b8a8-f8ca435f138e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8436f92a-7377-4767-b8a8-f8ca435f138e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f2833a-c560-45fa-99f1-2d91263e86fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:59 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Volume a540af9a-b640-4d53-9b52-0c4d8bf572b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a540af9a-b640-4d53-9b52-0c4d8bf572b0', 'volume_size': 1} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-680139226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a540af9a-b640-4d53-9b52-0c4d8bf572b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aed18ca480d4fb3a767445a6025637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:00Z,use_quota=True,user_id='fd6f62aa31b7493b8e62b823c2b23481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Creating volume a540af9a-b640-4d53-9b52-0c4d8bf572b0 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:49:59 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:49:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a540af9a-b640-4d53-9b52-0c4d8bf572b0 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:59 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a540af9a-b640-4d53-9b52-0c4d8bf572b0 1073741824 Nov 02 10:49:59 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:00 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a540af9a-b640-4d53-9b52-0c4d8bf572b0 1073741824" returned: 0 in 0.828s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a540af9a-b640-4d53-9b52-0c4d8bf572b0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:00 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a540af9a-b640-4d53-9b52-0c4d8bf572b0 Nov 02 10:50:00 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:01 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a540af9a-b640-4d53-9b52-0c4d8bf572b0" returned: 0 in 0.348s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:50:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f2833a-c560-45fa-99f1-2d91263e86fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a540af9a-b640-4d53-9b52-0c4d8bf572b0', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1596c704-dfda-492d-9e9b-91e5a3fc912c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:01 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Volume volume-a540af9a-b640-4d53-9b52-0c4d8bf572b0 (a540af9a-b640-4d53-9b52-0c4d8bf572b0): created successfully Nov 02 10:50:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1596c704-dfda-492d-9e9b-91e5a3fc912c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Flow 'volume_create_manager' (8e8be079-f730-476b-acb9-983103091a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:01 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-979b5e75-8b50-46f2-8253-46a04b04336d tempest-VolumesActionsTest-1580589606 None] Created volume successfully. Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-780937ff-2379-4356-9c07-d221efbe2d50 tempest-VolumesActionsTest-301136523 None] Acquiring lock "cinder-a540af9a-b640-4d53-9b52-0c4d8bf572b0-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-780937ff-2379-4356-9c07-d221efbe2d50 tempest-VolumesActionsTest-301136523 None] Lock "cinder-a540af9a-b640-4d53-9b52-0c4d8bf572b0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-780937ff-2379-4356-9c07-d221efbe2d50 tempest-VolumesActionsTest-301136523 None] Acquiring lock "cinder-quobyte-a540af9a-b640-4d53-9b52-0c4d8bf572b0" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-780937ff-2379-4356-9c07-d221efbe2d50 tempest-VolumesActionsTest-301136523 None] Lock "cinder-quobyte-a540af9a-b640-4d53-9b52-0c4d8bf572b0" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b7a0a2-a3f7-440e-af16-67fa7a0d3bc5]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-780937ff-2379-4356-9c07-d221efbe2d50 tempest-VolumesActionsTest-301136523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a540af9a-b640-4d53-9b52-0c4d8bf572b0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Flow 'volume_create_manager' (c44cc3ca-1aae-4417-8727-73c264d5d452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fa5276-4d0c-4663-9d01-4e586eedfadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fa5276-4d0c-4663-9d01-4e586eedfadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-618040989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58151186-60fa-4f7d-96b7-de62622cdab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1527140b446a493290f59474b9d930ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:02Z,use_quota=True,user_id='c36dbb8c255142a2aef3435f72cc12a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22cc0b4c-aa5d-49e4-8ce4-e9667807cdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22cc0b4c-aa5d-49e4-8ce4-e9667807cdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e66990-78b8-4e0e-9d82-d0af31852d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e66990-78b8-4e0e-9d82-d0af31852d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58151186-60fa-4f7d-96b7-de62622cdab3', 'volume_name': 'volume-58151186-60fa-4f7d-96b7-de62622cdab3', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34383c0b-9517-482e-8fcb-a4141e846961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34383c0b-9517-482e-8fcb-a4141e846961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562fb354-6a3c-4848-aa88-f05340201e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:02 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Volume 58151186-60fa-4f7d-96b7-de62622cdab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58151186-60fa-4f7d-96b7-de62622cdab3', 'volume_size': 1} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-618040989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58151186-60fa-4f7d-96b7-de62622cdab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1527140b446a493290f59474b9d930ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:02Z,use_quota=True,user_id='c36dbb8c255142a2aef3435f72cc12a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Creating volume 58151186-60fa-4f7d-96b7-de62622cdab3 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:50:02 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-58151186-60fa-4f7d-96b7-de62622cdab3 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:02 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a540af9a-b640-4d53-9b52-0c4d8bf572b0 Nov 02 10:50:02 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:02 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-58151186-60fa-4f7d-96b7-de62622cdab3 1073741824 Nov 02 10:50:02 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:02 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-780937ff-2379-4356-9c07-d221efbe2d50 tempest-VolumesActionsTest-301136523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a540af9a-b640-4d53-9b52-0c4d8bf572b0" returned: 0 in 0.524s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-780937ff-2379-4356-9c07-d221efbe2d50 tempest-VolumesActionsTest-301136523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a540af9a-b640-4d53-9b52-0c4d8bf572b0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:02 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a540af9a-b640-4d53-9b52-0c4d8bf572b0 Nov 02 10:50:02 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:03 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-780937ff-2379-4356-9c07-d221efbe2d50 tempest-VolumesActionsTest-301136523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a540af9a-b640-4d53-9b52-0c4d8bf572b0" returned: 0 in 0.335s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-780937ff-2379-4356-9c07-d221efbe2d50 tempest-VolumesActionsTest-301136523 None] Lock "cinder-quobyte-a540af9a-b640-4d53-9b52-0c4d8bf572b0" released by "delete_volume" :: held 0.929s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:03 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-58151186-60fa-4f7d-96b7-de62622cdab3 1073741824" returned: 0 in 0.710s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-58151186-60fa-4f7d-96b7-de62622cdab3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:03 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-58151186-60fa-4f7d-96b7-de62622cdab3 Nov 02 10:50:03 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-780937ff-2379-4356-9c07-d221efbe2d50 tempest-VolumesActionsTest-301136523 None] Created reservations ['a7b71c85-d764-4038-9342-5f9570745492', '1eb56aa6-0aed-47de-95e5-1e06cea98a84', 'f82070a6-3eac-40c0-872b-b68291b90ab3', '53e084fd-ad71-4c18-90ba-4a2034f8b97f'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-780937ff-2379-4356-9c07-d221efbe2d50 tempest-VolumesActionsTest-301136523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-780937ff-2379-4356-9c07-d221efbe2d50 tempest-VolumesActionsTest-301136523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-780937ff-2379-4356-9c07-d221efbe2d50 tempest-VolumesActionsTest-301136523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-780937ff-2379-4356-9c07-d221efbe2d50 tempest-VolumesActionsTest-301136523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-780937ff-2379-4356-9c07-d221efbe2d50 tempest-VolumesActionsTest-301136523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-780937ff-2379-4356-9c07-d221efbe2d50 tempest-VolumesActionsTest-301136523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:03 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:50:03 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:03 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-58151186-60fa-4f7d-96b7-de62622cdab3" returned: 0 in 0.319s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562fb354-6a3c-4848-aa88-f05340201e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58151186-60fa-4f7d-96b7-de62622cdab3', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a34facc-a4a0-4a55-bfb5-98f93afe48a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:03 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Volume volume-58151186-60fa-4f7d-96b7-de62622cdab3 (58151186-60fa-4f7d-96b7-de62622cdab3): created successfully Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a34facc-a4a0-4a55-bfb5-98f93afe48a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Flow 'volume_create_manager' (c44cc3ca-1aae-4417-8727-73c264d5d452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-15e579e1-4d82-4dde-ab07-23985c882f75 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Created volume successfully. Nov 02 10:50:03 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-780937ff-2379-4356-9c07-d221efbe2d50 tempest-VolumesActionsTest-301136523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.324s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-780937ff-2379-4356-9c07-d221efbe2d50 tempest-VolumesActionsTest-301136523 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-780937ff-2379-4356-9c07-d221efbe2d50 tempest-VolumesActionsTest-301136523 None] Deleted volume successfully. Nov 02 10:50:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-780937ff-2379-4356-9c07-d221efbe2d50 tempest-VolumesActionsTest-301136523 None] Lock "cinder-a540af9a-b640-4d53-9b52-0c4d8bf572b0-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Flow 'volume_create_manager' (29b5887a-38b6-4e8c-9c26-de688e91941a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0752b5ec-1f39-42ee-abe2-08a3d39a1783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0752b5ec-1f39-42ee-abe2-08a3d39a1783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1677590254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e0a05e-0e2a-4a66-b01c-e6bd13946aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aed18ca480d4fb3a767445a6025637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:05Z,use_quota=True,user_id='fd6f62aa31b7493b8e62b823c2b23481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ced62c9-b6b6-4b61-9f9c-1251c61a7ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ced62c9-b6b6-4b61-9f9c-1251c61a7ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc2aed32-3e0a-4a45-b74f-ac75eded4853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc2aed32-3e0a-4a45-b74f-ac75eded4853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8e0a05e-0e2a-4a66-b01c-e6bd13946aee', 'volume_name': 'volume-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adef7c09-a98a-4ddd-9109-a3b339d8268f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adef7c09-a98a-4ddd-9109-a3b339d8268f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7084081-abe1-41f0-9bd8-2619dcd05d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:05 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Volume f8e0a05e-0e2a-4a66-b01c-e6bd13946aee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee', 'volume_size': 1} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1677590254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e0a05e-0e2a-4a66-b01c-e6bd13946aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aed18ca480d4fb3a767445a6025637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:05Z,use_quota=True,user_id='fd6f62aa31b7493b8e62b823c2b23481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Creating volume f8e0a05e-0e2a-4a66-b01c-e6bd13946aee {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:50:05 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:05 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee 1073741824 Nov 02 10:50:05 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:05 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee 1073741824" returned: 0 in 0.574s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:05 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee Nov 02 10:50:05 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1bbd9d59-5634-43cd-a6f4-625258541621 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Acquiring lock "cinder-58151186-60fa-4f7d-96b7-de62622cdab3-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1bbd9d59-5634-43cd-a6f4-625258541621 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Lock "cinder-58151186-60fa-4f7d-96b7-de62622cdab3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1bbd9d59-5634-43cd-a6f4-625258541621 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Acquiring lock "cinder-quobyte-58151186-60fa-4f7d-96b7-de62622cdab3" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:06 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee" returned: 0 in 0.366s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:50:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1bbd9d59-5634-43cd-a6f4-625258541621 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Lock "cinder-quobyte-58151186-60fa-4f7d-96b7-de62622cdab3" acquired by "delete_volume" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7084081-abe1-41f0-9bd8-2619dcd05d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54949fa-4117-4fd9-a985-b264019fd87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:06 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e76fc9-0324-48fc-af17-81981114fc9a]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1bbd9d59-5634-43cd-a6f4-625258541621 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-58151186-60fa-4f7d-96b7-de62622cdab3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:06 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Volume volume-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee (f8e0a05e-0e2a-4a66-b01c-e6bd13946aee): created successfully Nov 02 10:50:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54949fa-4117-4fd9-a985-b264019fd87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Flow 'volume_create_manager' (29b5887a-38b6-4e8c-9c26-de688e91941a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:06 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b00bceb3-08e9-41ec-bc26-b105d4304964 tempest-VolumesActionsTest-1580589606 None] Created volume successfully. Nov 02 10:50:06 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-58151186-60fa-4f7d-96b7-de62622cdab3 Nov 02 10:50:06 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:06 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1bbd9d59-5634-43cd-a6f4-625258541621 tempest-VolumeQuotasNegativeTestJSON-341620049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-58151186-60fa-4f7d-96b7-de62622cdab3" returned: 0 in 0.521s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1bbd9d59-5634-43cd-a6f4-625258541621 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-58151186-60fa-4f7d-96b7-de62622cdab3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:06 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-58151186-60fa-4f7d-96b7-de62622cdab3 Nov 02 10:50:06 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:07 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1bbd9d59-5634-43cd-a6f4-625258541621 tempest-VolumeQuotasNegativeTestJSON-341620049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-58151186-60fa-4f7d-96b7-de62622cdab3" returned: 0 in 0.301s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1bbd9d59-5634-43cd-a6f4-625258541621 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Lock "cinder-quobyte-58151186-60fa-4f7d-96b7-de62622cdab3" released by "delete_volume" :: held 0.902s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:07 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-1bbd9d59-5634-43cd-a6f4-625258541621 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Created reservations ['303723b0-8c96-4dd8-ac0a-2af5d08f4353', '704d990f-59a9-4389-bdce-fd8084caa8ad', '9dbbc12f-7bfc-48ad-bf6e-f5318be42931', '066bcde0-ce7d-49f7-b51a-398fa6cc891c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1bbd9d59-5634-43cd-a6f4-625258541621 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1bbd9d59-5634-43cd-a6f4-625258541621 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1bbd9d59-5634-43cd-a6f4-625258541621 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1bbd9d59-5634-43cd-a6f4-625258541621 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1bbd9d59-5634-43cd-a6f4-625258541621 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1bbd9d59-5634-43cd-a6f4-625258541621 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:07 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:50:07 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39ee9f12-b775-46d1-98f1-92407ab4f2ba tempest-VolumesActionsTest-301136523 None] Acquiring lock "cinder-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39ee9f12-b775-46d1-98f1-92407ab4f2ba tempest-VolumesActionsTest-301136523 None] Lock "cinder-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39ee9f12-b775-46d1-98f1-92407ab4f2ba tempest-VolumesActionsTest-301136523 None] Acquiring lock "cinder-quobyte-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39ee9f12-b775-46d1-98f1-92407ab4f2ba tempest-VolumesActionsTest-301136523 None] Lock "cinder-quobyte-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee" acquired by "delete_volume" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:07 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[54887c64-f264-4f32-b414-dcac77734f7f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39ee9f12-b775-46d1-98f1-92407ab4f2ba tempest-VolumesActionsTest-301136523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:07 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1bbd9d59-5634-43cd-a6f4-625258541621 tempest-VolumeQuotasNegativeTestJSON-341620049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.553s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:07 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-1bbd9d59-5634-43cd-a6f4-625258541621 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:07 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1bbd9d59-5634-43cd-a6f4-625258541621 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Deleted volume successfully. Nov 02 10:50:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1bbd9d59-5634-43cd-a6f4-625258541621 tempest-VolumeQuotasNegativeTestJSON-341620049 None] Lock "cinder-58151186-60fa-4f7d-96b7-de62622cdab3-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:07 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee Nov 02 10:50:07 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:08 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39ee9f12-b775-46d1-98f1-92407ab4f2ba tempest-VolumesActionsTest-301136523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee" returned: 0 in 0.479s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39ee9f12-b775-46d1-98f1-92407ab4f2ba tempest-VolumesActionsTest-301136523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:08 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee Nov 02 10:50:08 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:08 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39ee9f12-b775-46d1-98f1-92407ab4f2ba tempest-VolumesActionsTest-301136523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee" returned: 0 in 0.359s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39ee9f12-b775-46d1-98f1-92407ab4f2ba tempest-VolumesActionsTest-301136523 None] Lock "cinder-quobyte-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee" released by "delete_volume" :: held 0.914s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:08 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-39ee9f12-b775-46d1-98f1-92407ab4f2ba tempest-VolumesActionsTest-301136523 None] Created reservations ['dd92c830-e182-4fa0-adc1-db764faecf73', 'effd0fc3-35cc-49a0-a710-ebb061a6f1a6', '7c61f83d-dbf3-4d1a-b9e3-f180d049940f', 'af80d552-286e-433a-af4e-16de38b236f0'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-39ee9f12-b775-46d1-98f1-92407ab4f2ba tempest-VolumesActionsTest-301136523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-39ee9f12-b775-46d1-98f1-92407ab4f2ba tempest-VolumesActionsTest-301136523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-39ee9f12-b775-46d1-98f1-92407ab4f2ba tempest-VolumesActionsTest-301136523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-39ee9f12-b775-46d1-98f1-92407ab4f2ba tempest-VolumesActionsTest-301136523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-39ee9f12-b775-46d1-98f1-92407ab4f2ba tempest-VolumesActionsTest-301136523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39ee9f12-b775-46d1-98f1-92407ab4f2ba tempest-VolumesActionsTest-301136523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:08 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:50:08 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:09 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39ee9f12-b775-46d1-98f1-92407ab4f2ba tempest-VolumesActionsTest-301136523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.568s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:09 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-39ee9f12-b775-46d1-98f1-92407ab4f2ba tempest-VolumesActionsTest-301136523 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:09 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-39ee9f12-b775-46d1-98f1-92407ab4f2ba tempest-VolumesActionsTest-301136523 None] Deleted volume successfully. Nov 02 10:50:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39ee9f12-b775-46d1-98f1-92407ab4f2ba tempest-VolumesActionsTest-301136523 None] Lock "cinder-f8e0a05e-0e2a-4a66-b01c-e6bd13946aee-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Flow 'volume_create_manager' (de56d10a-0a19-4eeb-a75b-6e120c3c7ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb91cf1-e0d5-4b4b-834c-4308db42f068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb91cf1-e0d5-4b4b-834c-4308db42f068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1739083391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2944f1ef-4ecf-46c4-98bd-6fd49e99a514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aed18ca480d4fb3a767445a6025637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:10Z,use_quota=True,user_id='fd6f62aa31b7493b8e62b823c2b23481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3090e1ec-563c-4f87-89c2-84fb33f8db5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3090e1ec-563c-4f87-89c2-84fb33f8db5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de473455-491c-4b96-834a-a8da2577751a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de473455-491c-4b96-834a-a8da2577751a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2944f1ef-4ecf-46c4-98bd-6fd49e99a514', 'volume_name': 'volume-2944f1ef-4ecf-46c4-98bd-6fd49e99a514', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c083b4-c7a0-489c-b30d-3a27a48e58c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c083b4-c7a0-489c-b30d-3a27a48e58c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d152def-feed-48e8-a8f1-467e7403cd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:10 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Volume 2944f1ef-4ecf-46c4-98bd-6fd49e99a514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2944f1ef-4ecf-46c4-98bd-6fd49e99a514', 'volume_size': 1} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1739083391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2944f1ef-4ecf-46c4-98bd-6fd49e99a514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aed18ca480d4fb3a767445a6025637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:10Z,use_quota=True,user_id='fd6f62aa31b7493b8e62b823c2b23481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Creating volume 2944f1ef-4ecf-46c4-98bd-6fd49e99a514 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:50:10 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2944f1ef-4ecf-46c4-98bd-6fd49e99a514 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:10 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2944f1ef-4ecf-46c4-98bd-6fd49e99a514 1073741824 Nov 02 10:50:10 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:10 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2944f1ef-4ecf-46c4-98bd-6fd49e99a514 1073741824" returned: 0 in 0.625s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2944f1ef-4ecf-46c4-98bd-6fd49e99a514 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:10 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2944f1ef-4ecf-46c4-98bd-6fd49e99a514 Nov 02 10:50:10 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:11 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2944f1ef-4ecf-46c4-98bd-6fd49e99a514" returned: 0 in 0.386s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:50:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d152def-feed-48e8-a8f1-467e7403cd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2944f1ef-4ecf-46c4-98bd-6fd49e99a514', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecb0f71-de38-4ab4-8429-f5092acdc008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:11 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Volume volume-2944f1ef-4ecf-46c4-98bd-6fd49e99a514 (2944f1ef-4ecf-46c4-98bd-6fd49e99a514): created successfully Nov 02 10:50:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecb0f71-de38-4ab4-8429-f5092acdc008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Flow 'volume_create_manager' (de56d10a-0a19-4eeb-a75b-6e120c3c7ec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:11 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-dddc8b35-1349-4dc1-889c-cb71e8e10c8e tempest-VolumesActionsTest-1580589606 None] Created volume successfully. Nov 02 10:50:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0634b0b0-f38b-4896-819b-153f1ec22112 tempest-VolumesActionsTest-1580589606 None] Acquiring lock "cinder-2944f1ef-4ecf-46c4-98bd-6fd49e99a514-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0634b0b0-f38b-4896-819b-153f1ec22112 tempest-VolumesActionsTest-1580589606 None] Lock "cinder-2944f1ef-4ecf-46c4-98bd-6fd49e99a514-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0634b0b0-f38b-4896-819b-153f1ec22112 tempest-VolumesActionsTest-1580589606 None] Acquiring lock "cinder-quobyte-2944f1ef-4ecf-46c4-98bd-6fd49e99a514" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0634b0b0-f38b-4896-819b-153f1ec22112 tempest-VolumesActionsTest-1580589606 None] Lock "cinder-quobyte-2944f1ef-4ecf-46c4-98bd-6fd49e99a514" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:12 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[763151b2-cd12-42b9-bd2d-d5f424348971]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0634b0b0-f38b-4896-819b-153f1ec22112 tempest-VolumesActionsTest-1580589606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2944f1ef-4ecf-46c4-98bd-6fd49e99a514 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:13 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2944f1ef-4ecf-46c4-98bd-6fd49e99a514 Nov 02 10:50:13 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:13 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0634b0b0-f38b-4896-819b-153f1ec22112 tempest-VolumesActionsTest-1580589606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2944f1ef-4ecf-46c4-98bd-6fd49e99a514" returned: 0 in 0.426s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0634b0b0-f38b-4896-819b-153f1ec22112 tempest-VolumesActionsTest-1580589606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2944f1ef-4ecf-46c4-98bd-6fd49e99a514 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:13 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2944f1ef-4ecf-46c4-98bd-6fd49e99a514 Nov 02 10:50:13 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:13 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0634b0b0-f38b-4896-819b-153f1ec22112 tempest-VolumesActionsTest-1580589606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2944f1ef-4ecf-46c4-98bd-6fd49e99a514" returned: 0 in 0.326s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0634b0b0-f38b-4896-819b-153f1ec22112 tempest-VolumesActionsTest-1580589606 None] Lock "cinder-quobyte-2944f1ef-4ecf-46c4-98bd-6fd49e99a514" released by "delete_volume" :: held 0.810s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:13 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-0634b0b0-f38b-4896-819b-153f1ec22112 tempest-VolumesActionsTest-1580589606 None] Created reservations ['a7c9af62-607f-453d-adec-17ba8a9e5689', 'de081abf-8036-41d8-bfe6-4b948bb29850', 'ff3832a2-ae0b-43ac-8ef8-e2eda368e351', '66d55a26-cc4f-4b12-a05b-ad570d8f4a00'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0634b0b0-f38b-4896-819b-153f1ec22112 tempest-VolumesActionsTest-1580589606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0634b0b0-f38b-4896-819b-153f1ec22112 tempest-VolumesActionsTest-1580589606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0634b0b0-f38b-4896-819b-153f1ec22112 tempest-VolumesActionsTest-1580589606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0634b0b0-f38b-4896-819b-153f1ec22112 tempest-VolumesActionsTest-1580589606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0634b0b0-f38b-4896-819b-153f1ec22112 tempest-VolumesActionsTest-1580589606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0634b0b0-f38b-4896-819b-153f1ec22112 tempest-VolumesActionsTest-1580589606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:13 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:50:13 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:14 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0634b0b0-f38b-4896-819b-153f1ec22112 tempest-VolumesActionsTest-1580589606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.315s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:14 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-0634b0b0-f38b-4896-819b-153f1ec22112 tempest-VolumesActionsTest-1580589606 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0634b0b0-f38b-4896-819b-153f1ec22112 tempest-VolumesActionsTest-1580589606 None] Deleted volume successfully. Nov 02 10:50:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0634b0b0-f38b-4896-819b-153f1ec22112 tempest-VolumesActionsTest-1580589606 None] Lock "cinder-2944f1ef-4ecf-46c4-98bd-6fd49e99a514-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Flow 'volume_create_manager' (4d6eabdc-6a37-425e-ad6a-e3d2fdad65c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60c5227-2530-448c-bd96-9a62df0e030c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60c5227-2530-448c-bd96-9a62df0e030c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1448245922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2189e2-2130-421b-8f85-9d550c3b007c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8922ca94441c4784932a47008dfe7dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:18Z,use_quota=True,user_id='727708d062bc43d99cacfa3c77c1f138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdd6603-6afb-489d-b088-1165e6c0a77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdd6603-6afb-489d-b088-1165e6c0a77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de512c4-376c-40c9-8b67-33fc877094ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de512c4-376c-40c9-8b67-33fc877094ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc2189e2-2130-421b-8f85-9d550c3b007c', 'volume_name': 'volume-fc2189e2-2130-421b-8f85-9d550c3b007c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7908f2-7e07-48dd-988d-19ab59e3b64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7908f2-7e07-48dd-988d-19ab59e3b64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca35ddc9-3cbf-42e1-8f2e-ec44099d5ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:18 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Volume fc2189e2-2130-421b-8f85-9d550c3b007c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc2189e2-2130-421b-8f85-9d550c3b007c', 'volume_size': 1} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1448245922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2189e2-2130-421b-8f85-9d550c3b007c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8922ca94441c4784932a47008dfe7dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:18Z,use_quota=True,user_id='727708d062bc43d99cacfa3c77c1f138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Creating volume fc2189e2-2130-421b-8f85-9d550c3b007c {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:50:18 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:50:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:18 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c 1073741824 Nov 02 10:50:18 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:19 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c 1073741824" returned: 0 in 0.600s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:19 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c Nov 02 10:50:19 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:19 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c" returned: 0 in 0.279s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:50:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca35ddc9-3cbf-42e1-8f2e-ec44099d5ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc2189e2-2130-421b-8f85-9d550c3b007c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (211dc76d-5484-4ffb-8706-9156b167f8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:19 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Volume volume-fc2189e2-2130-421b-8f85-9d550c3b007c (fc2189e2-2130-421b-8f85-9d550c3b007c): created successfully Nov 02 10:50:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (211dc76d-5484-4ffb-8706-9156b167f8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Flow 'volume_create_manager' (4d6eabdc-6a37-425e-ad6a-e3d2fdad65c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:19 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6c79d182-115f-4d5b-8d53-8b27f479d147 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Created volume successfully. Nov 02 10:50:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b419c902-207d-43f8-8f71-beb1543773d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b419c902-207d-43f8-8f71-beb1543773d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b419c902-207d-43f8-8f71-beb1543773d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Creating offline snapshot 87a82411-c1ad-40fe-8f81-a457a213fb08 of volume fc2189e2-2130-421b-8f85-9d550c3b007c {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:50:20 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53c9936-b74d-4204-8c5f-f6a91278782f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b419c902-207d-43f8-8f71-beb1543773d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:21 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c Nov 02 10:50:21 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:21 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b419c902-207d-43f8-8f71-beb1543773d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c" returned: 0 in 0.457s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b419c902-207d-43f8-8f71-beb1543773d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.87a82411-c1ad-40fe-8f81-a457a213fb08 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:21 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.87a82411-c1ad-40fe-8f81-a457a213fb08 1G Nov 02 10:50:21 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:22 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b419c902-207d-43f8-8f71-beb1543773d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.87a82411-c1ad-40fe-8f81-a457a213fb08 1G" returned: 0 in 0.662s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b419c902-207d-43f8-8f71-beb1543773d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2189e2-2130-421b-8f85-9d550c3b007c -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.87a82411-c1ad-40fe-8f81-a457a213fb08 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:22 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2189e2-2130-421b-8f85-9d550c3b007c -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.87a82411-c1ad-40fe-8f81-a457a213fb08 Nov 02 10:50:22 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:22 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b419c902-207d-43f8-8f71-beb1543773d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2189e2-2130-421b-8f85-9d550c3b007c -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.87a82411-c1ad-40fe-8f81-a457a213fb08" returned: 0 in 0.552s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:22 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-b419c902-207d-43f8-8f71-beb1543773d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.87a82411-c1ad-40fe-8f81-a457a213fb08 is being set with open permissions: ugo+rw Nov 02 10:50:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b419c902-207d-43f8-8f71-beb1543773d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.87a82411-c1ad-40fe-8f81-a457a213fb08 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:22 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.87a82411-c1ad-40fe-8f81-a457a213fb08 Nov 02 10:50:22 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:23 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b419c902-207d-43f8-8f71-beb1543773d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.87a82411-c1ad-40fe-8f81-a457a213fb08" returned: 0 in 0.526s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:23 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=84,cinder:UPDATE=123,cinder:DELETE=13,cinder:INSERT=23 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:50:23 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=98,cinder:UPDATE=118,cinder:INSERT=33,cinder:DELETE=7 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:50:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b419c902-207d-43f8-8f71-beb1543773d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:23 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.info Nov 02 10:50:23 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:23 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b419c902-207d-43f8-8f71-beb1543773d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.info" returned: 0 in 0.457s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:23 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-b419c902-207d-43f8-8f71-beb1543773d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.info is being set with open permissions: ugo+rw Nov 02 10:50:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b419c902-207d-43f8-8f71-beb1543773d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:23 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.info Nov 02 10:50:23 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:24 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b419c902-207d-43f8-8f71-beb1543773d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.info" returned: 0 in 0.315s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b419c902-207d-43f8-8f71-beb1543773d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.130s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:24 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b419c902-207d-43f8-8f71-beb1543773d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Create snapshot completed successfully Nov 02 10:50:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Acquiring lock "cinder-87a82411-c1ad-40fe-8f81-a457a213fb08-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Lock "cinder-87a82411-c1ad-40fe-8f81-a457a213fb08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Acquiring lock "cinder-quobyte-fc2189e2-2130-421b-8f85-9d550c3b007c" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Lock "cinder-quobyte-fc2189e2-2130-421b-8f85-9d550c3b007c" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Acquiring lock "cinder-quobyte-87a82411-c1ad-40fe-8f81-a457a213fb08" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Lock "cinder-quobyte-87a82411-c1ad-40fe-8f81-a457a213fb08" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Deleting offline snapshot 87a82411-c1ad-40fe-8f81-a457a213fb08 of volume fc2189e2-2130-421b-8f85-9d550c3b007c {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:50:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] snapshot_file for this snap is: volume-fc2189e2-2130-421b-8f85-9d550c3b007c.87a82411-c1ad-40fe-8f81-a457a213fb08 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:50:26 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc8ab88-f09b-46c0-8f5c-a0c2d632d92f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.87a82411-c1ad-40fe-8f81-a457a213fb08 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:26 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.87a82411-c1ad-40fe-8f81-a457a213fb08 Nov 02 10:50:26 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:26 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.87a82411-c1ad-40fe-8f81-a457a213fb08" returned: 0 in 0.490s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc2189e2-2130-421b-8f85-9d550c3b007c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:50:26 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4286d7-9e7e-4468-85ba-493bb88a299b]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:26 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c Nov 02 10:50:26 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:27 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c" returned: 0 in 0.478s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.87a82411-c1ad-40fe-8f81-a457a213fb08 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:27 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.87a82411-c1ad-40fe-8f81-a457a213fb08 Nov 02 10:50:27 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:27 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.87a82411-c1ad-40fe-8f81-a457a213fb08" returned: 0 in 0.486s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.87a82411-c1ad-40fe-8f81-a457a213fb08 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:27 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.87a82411-c1ad-40fe-8f81-a457a213fb08 Nov 02 10:50:27 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:28 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c.87a82411-c1ad-40fe-8f81-a457a213fb08" returned: 0 in 0.432s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Lock "cinder-quobyte-87a82411-c1ad-40fe-8f81-a457a213fb08" released by "_delete_snapshot" :: held 2.061s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Lock "cinder-quobyte-fc2189e2-2130-421b-8f85-9d550c3b007c" released by "delete_snapshot" :: held 2.095s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:28 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Created reservations ['b25509d9-1f5f-4fde-9929-caef279c4c09', 'a54ab2fb-ad08-4e72-9599-32bce992b7ea', 'cfa7a6d5-dd08-4f6c-8b1d-bfc0214272ca', 'df5f3a08-1e14-478e-9fcb-a3a721e71fd7'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:28 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Delete snapshot completed successfully. Nov 02 10:50:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63a704f2-4432-4c3f-994d-202d8cd886ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Lock "cinder-87a82411-c1ad-40fe-8f81-a457a213fb08-delete_snapshot" released by "delete_snapshot" :: held 2.350s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:28 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Flow 'volume_create_manager' (a956987d-80f6-4b0f-94b6-4546971eb96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c88587af-90a0-4100-9e9c-1d92cfb22313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c88587af-90a0-4100-9e9c-1d92cfb22313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1656316781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49cdb182-ec55-46b5-bb80-7f98dbec135a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e688d33c3fc44d9d99ffae8948c055cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:29Z,use_quota=True,user_id='9d1611e597db4d078a6c71ca493afca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(400863b6-98db-4fe3-9345-ba67aa55e8ff),volume_type_id=400863b6-98db-4fe3-9345-ba67aa55e8ff)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcc9156-b6e8-47cf-98fe-c3bc3f8124f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcc9156-b6e8-47cf-98fe-c3bc3f8124f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c495aa-d122-484b-aab7-633d1a8a13b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c495aa-d122-484b-aab7-633d1a8a13b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49cdb182-ec55-46b5-bb80-7f98dbec135a', 'volume_name': 'volume-49cdb182-ec55-46b5-bb80-7f98dbec135a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b4ca9db-8139-4bd2-877f-cf1fab93fd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b4ca9db-8139-4bd2-877f-cf1fab93fd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2001ef95-29a9-4170-b6e5-053cd34dd0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:29 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Volume 49cdb182-ec55-46b5-bb80-7f98dbec135a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49cdb182-ec55-46b5-bb80-7f98dbec135a', 'volume_size': 1} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1656316781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49cdb182-ec55-46b5-bb80-7f98dbec135a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e688d33c3fc44d9d99ffae8948c055cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:29Z,use_quota=True,user_id='9d1611e597db4d078a6c71ca493afca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(400863b6-98db-4fe3-9345-ba67aa55e8ff),volume_type_id=400863b6-98db-4fe3-9345-ba67aa55e8ff)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Creating volume 49cdb182-ec55-46b5-bb80-7f98dbec135a {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:50:29 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-49cdb182-ec55-46b5-bb80-7f98dbec135a 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:29 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-49cdb182-ec55-46b5-bb80-7f98dbec135a 1073741824 Nov 02 10:50:29 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d08d2767-dbe3-4d61-983f-633a143701c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Acquiring lock "cinder-fc2189e2-2130-421b-8f85-9d550c3b007c-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d08d2767-dbe3-4d61-983f-633a143701c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Lock "cinder-fc2189e2-2130-421b-8f85-9d550c3b007c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d08d2767-dbe3-4d61-983f-633a143701c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Acquiring lock "cinder-quobyte-fc2189e2-2130-421b-8f85-9d550c3b007c" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d08d2767-dbe3-4d61-983f-633a143701c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Lock "cinder-quobyte-fc2189e2-2130-421b-8f85-9d550c3b007c" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a71d3d5-3789-410a-a26f-a2aa5486b1a2]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d08d2767-dbe3-4d61-983f-633a143701c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Flow 'volume_create_manager' (9053ab89-4745-4d61-888a-74ed5dccb03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46c9821-62ae-467c-b039-6ac8727ef3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46c9821-62ae-467c-b039-6ac8727ef3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-563277163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f172c1b-7372-4b34-bd79-e2d8b6a1b128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e688d33c3fc44d9d99ffae8948c055cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:30Z,use_quota=True,user_id='9d1611e597db4d078a6c71ca493afca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48540c76-89bb-403f-beca-1c233c3dcb2d),volume_type_id=48540c76-89bb-403f-beca-1c233c3dcb2d)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97255843-b520-4164-af7a-b85c80495f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97255843-b520-4164-af7a-b85c80495f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (020f4b2a-1889-4af6-94f0-f0607940a74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (020f4b2a-1889-4af6-94f0-f0607940a74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f172c1b-7372-4b34-bd79-e2d8b6a1b128', 'volume_name': 'volume-4f172c1b-7372-4b34-bd79-e2d8b6a1b128', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401cbd9b-58af-4525-b16f-54b5d34f49f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401cbd9b-58af-4525-b16f-54b5d34f49f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f44c75f-bbc1-451c-9ccb-0472fc0de878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:29 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Volume 4f172c1b-7372-4b34-bd79-e2d8b6a1b128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f172c1b-7372-4b34-bd79-e2d8b6a1b128', 'volume_size': 1} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:29 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c Nov 02 10:50:29 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:29 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-49cdb182-ec55-46b5-bb80-7f98dbec135a 1073741824" returned: 0 in 0.722s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-49cdb182-ec55-46b5-bb80-7f98dbec135a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:29 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-49cdb182-ec55-46b5-bb80-7f98dbec135a Nov 02 10:50:29 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:30 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d08d2767-dbe3-4d61-983f-633a143701c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c" returned: 0 in 0.549s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d08d2767-dbe3-4d61-983f-633a143701c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:30 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c Nov 02 10:50:30 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:30 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-49cdb182-ec55-46b5-bb80-7f98dbec135a" returned: 0 in 0.304s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.455s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-563277163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f172c1b-7372-4b34-bd79-e2d8b6a1b128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e688d33c3fc44d9d99ffae8948c055cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:30Z,use_quota=True,user_id='9d1611e597db4d078a6c71ca493afca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48540c76-89bb-403f-beca-1c233c3dcb2d),volume_type_id=48540c76-89bb-403f-beca-1c233c3dcb2d)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Creating volume 4f172c1b-7372-4b34-bd79-e2d8b6a1b128 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.052s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:50:30 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f172c1b-7372-4b34-bd79-e2d8b6a1b128 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:30 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f172c1b-7372-4b34-bd79-e2d8b6a1b128 1073741824 Nov 02 10:50:30 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2001ef95-29a9-4170-b6e5-053cd34dd0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49cdb182-ec55-46b5-bb80-7f98dbec135a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f88486a-c8ed-4ff0-b639-647696d56195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Flow 'volume_create_manager' (83382fde-e15e-4acf-8ff7-08fb6368190c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767128ad-3385-4886-a0e7-95a1a7c32e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:30 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Volume volume-49cdb182-ec55-46b5-bb80-7f98dbec135a (49cdb182-ec55-46b5-bb80-7f98dbec135a): created successfully Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f88486a-c8ed-4ff0-b639-647696d56195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Flow 'volume_create_manager' (a956987d-80f6-4b0f-94b6-4546971eb96e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767128ad-3385-4886-a0e7-95a1a7c32e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-272670808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b31773-5008-4a02-8edc-9f1487846061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e688d33c3fc44d9d99ffae8948c055cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:30Z,use_quota=True,user_id='9d1611e597db4d078a6c71ca493afca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bd311c3-dc72-44e7-9d08-2ca855f1e2c6),volume_type_id=2bd311c3-dc72-44e7-9d08-2ca855f1e2c6)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be736f1-0667-48b1-ab49-cf3cf3cba54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be736f1-0667-48b1-ab49-cf3cf3cba54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980f817c-80d7-465b-948b-15034986ebd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.image.glance [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Creating Keystone auth plugin from conf {{(pid=87084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:50:30 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:30 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-163f8506-fe6b-4d2a-9973-c653332ebe76 tempest-TestInstancesWithCinderVolumes-1565881454 None] Created volume successfully. Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d08d2767-dbe3-4d61-983f-633a143701c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fc2189e2-2130-421b-8f85-9d550c3b007c" returned: 0 in 0.396s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d08d2767-dbe3-4d61-983f-633a143701c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Lock "cinder-quobyte-fc2189e2-2130-421b-8f85-9d550c3b007c" released by "delete_volume" :: held 1.048s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-d08d2767-dbe3-4d61-983f-633a143701c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Created reservations ['c1be5bea-3c95-428c-a189-6a1f01b41d92', '45a782df-005c-42e7-a912-db3932378871', '641c8e07-dc74-4086-aa68-f1c1729700a7', '6c91540c-01ad-4187-b585-90e71f359ad0'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d08d2767-dbe3-4d61-983f-633a143701c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d08d2767-dbe3-4d61-983f-633a143701c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d08d2767-dbe3-4d61-983f-633a143701c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d08d2767-dbe3-4d61-983f-633a143701c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d08d2767-dbe3-4d61-983f-633a143701c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d08d2767-dbe3-4d61-983f-633a143701c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:30 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:50:30 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:30 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f172c1b-7372-4b34-bd79-e2d8b6a1b128 1073741824" returned: 0 in 0.643s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f172c1b-7372-4b34-bd79-e2d8b6a1b128 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:31 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f172c1b-7372-4b34-bd79-e2d8b6a1b128 Nov 02 10:50:31 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:31 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d08d2767-dbe3-4d61-983f-633a143701c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.391s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:31 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-d08d2767-dbe3-4d61-983f-633a143701c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d08d2767-dbe3-4d61-983f-633a143701c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Deleted volume successfully. Nov 02 10:50:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d08d2767-dbe3-4d61-983f-633a143701c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1371831633 None] Lock "cinder-fc2189e2-2130-421b-8f85-9d550c3b007c-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980f817c-80d7-465b-948b-15034986ebd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '02b31773-5008-4a02-8edc-9f1487846061', 'volume_name': 'volume-02b31773-5008-4a02-8edc-9f1487846061', 'volume_size': 1, 'image_id': '9b730ab7-7a85-4088-9490-d042df3590f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b730ab7-7a85-4088-9490-d042df3590f6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--219389391', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e688d33c3fc44d9d99ffae8948c055cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b730ab7-7a85-4088-9490-d042df3590f6', 'created_at': datetime.datetime(2026, 11, 2, 9, 50, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 50, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b730ab7-7a85-4088-9490-d042df3590f6/file', 'properties': {}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:31 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b16785-598a-4aaa-9ee1-922fb903de29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b16785-598a-4aaa-9ee1-922fb903de29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5cd9335-6f1c-44ec-b2c7-2b1f23460218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:31 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Volume 02b31773-5008-4a02-8edc-9f1487846061: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-02b31773-5008-4a02-8edc-9f1487846061', 'volume_size': 1, 'image_id': '9b730ab7-7a85-4088-9490-d042df3590f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b730ab7-7a85-4088-9490-d042df3590f6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--219389391', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e688d33c3fc44d9d99ffae8948c055cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b730ab7-7a85-4088-9490-d042df3590f6', 'created_at': datetime.datetime(2026, 11, 2, 9, 50, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 50, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b730ab7-7a85-4088-9490-d042df3590f6/file', 'properties': {}}, 'image_service': } Nov 02 10:50:31 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Trying to clone 02b31773-5008-4a02-8edc-9f1487846061 from image 9b730ab7-7a85-4088-9490-d042df3590f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9b730ab7-7a85-4088-9490-d042df3590f6', 'metadata': {}}]). {{(pid=87084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:50:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f172c1b-7372-4b34-bd79-e2d8b6a1b128" returned: 0 in 0.308s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:50:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f44c75f-bbc1-451c-9ccb-0472fc0de878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f172c1b-7372-4b34-bd79-e2d8b6a1b128', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f08f0dd-ed2d-4806-ba5d-bdb34f5a3f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:31 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Volume volume-4f172c1b-7372-4b34-bd79-e2d8b6a1b128 (4f172c1b-7372-4b34-bd79-e2d8b6a1b128): created successfully Nov 02 10:50:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f08f0dd-ed2d-4806-ba5d-bdb34f5a3f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Flow 'volume_create_manager' (9053ab89-4745-4d61-888a-74ed5dccb03d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-395ee468-5ff4-495a-9ecc-a61f7801d482 tempest-TestInstancesWithCinderVolumes-1565881454 None] Created volume successfully. Nov 02 10:50:35 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9b730ab7-7a85-4088-9490-d042df3590f6_kb952wp4devstack@QuobyteHD, size 20.69 MB, duration 3.74 sec {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:50:35 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Image download 20.69 MB at 5.54 MB/s Nov 02 10:50:35 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2122ef7-8f7c-4603-9b7f-9768ea90894b]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b730ab7-7a85-4088-9490-d042df3590f6_kb952wp4devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:35 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b730ab7-7a85-4088-9490-d042df3590f6_kb952wp4devstack@QuobyteHD Nov 02 10:50:35 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:35 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b730ab7-7a85-4088-9490-d042df3590f6_kb952wp4devstack@QuobyteHD" returned: 0 in 0.483s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:35 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Temporary image 9b730ab7-7a85-4088-9490-d042df3590f6 is fetched for user 9d1611e597db4d078a6c71ca493afca2. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:50:35 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[836284e4-c518-4ed1-bf53-c82acde9a998]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b730ab7-7a85-4088-9490-d042df3590f6_kb952wp4devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:35 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b730ab7-7a85-4088-9490-d042df3590f6_kb952wp4devstack@QuobyteHD Nov 02 10:50:35 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:36 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b730ab7-7a85-4088-9490-d042df3590f6_kb952wp4devstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-272670808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b31773-5008-4a02-8edc-9f1487846061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e688d33c3fc44d9d99ffae8948c055cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:30Z,use_quota=True,user_id='9d1611e597db4d078a6c71ca493afca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bd311c3-dc72-44e7-9d08-2ca855f1e2c6),volume_type_id=2bd311c3-dc72-44e7-9d08-2ca855f1e2c6)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:50:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Creating volume 02b31773-5008-4a02-8edc-9f1487846061 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:50:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:50:36 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:50:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-02b31773-5008-4a02-8edc-9f1487846061 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:36 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-02b31773-5008-4a02-8edc-9f1487846061 1073741824 Nov 02 10:50:36 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:36 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-02b31773-5008-4a02-8edc-9f1487846061 1073741824" returned: 0 in 0.683s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-02b31773-5008-4a02-8edc-9f1487846061 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:36 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-02b31773-5008-4a02-8edc-9f1487846061 Nov 02 10:50:36 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:37 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-02b31773-5008-4a02-8edc-9f1487846061" returned: 0 in 0.424s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:50:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:37 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Attempting download of 9b730ab7-7a85-4088-9490-d042df3590f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/9b730ab7-7a85-4088-9490-d042df3590f6', 'metadata': {}}])) to volume 02b31773-5008-4a02-8edc-9f1487846061. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:50:37 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c443c55a-5fcb-4878-92c8-c83b0e1774d6]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b730ab7-7a85-4088-9490-d042df3590f6_nuwq1m5s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:37 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b730ab7-7a85-4088-9490-d042df3590f6_nuwq1m5s Nov 02 10:50:37 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:37 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b730ab7-7a85-4088-9490-d042df3590f6_nuwq1m5s" returned: 0 in 0.395s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b730ab7-7a85-4088-9490-d042df3590f6_nuwq1m5s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:37 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b730ab7-7a85-4088-9490-d042df3590f6_nuwq1m5s Nov 02 10:50:37 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:38 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b730ab7-7a85-4088-9490-d042df3590f6_nuwq1m5s" returned: 1 in 0.368s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b730ab7-7a85-4088-9490-d042df3590f6_nuwq1m5s' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:50:38 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1574aa9-1284-4343-9c71-a9a0bd08d7ce]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b730ab7-7a85-4088-9490-d042df3590f6_kb952wp4devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:38 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b730ab7-7a85-4088-9490-d042df3590f6_kb952wp4devstack@QuobyteHD Nov 02 10:50:38 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:38 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b730ab7-7a85-4088-9490-d042df3590f6_kb952wp4devstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:38 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] 9b730ab7-7a85-4088-9490-d042df3590f6 was qcow2, converting to qcow2 {{(pid=87084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:50:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b730ab7-7a85-4088-9490-d042df3590f6_kb952wp4devstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-02b31773-5008-4a02-8edc-9f1487846061 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:38 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b730ab7-7a85-4088-9490-d042df3590f6_kb952wp4devstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-02b31773-5008-4a02-8edc-9f1487846061 Nov 02 10:50:38 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Flow 'volume_create_manager' (3aeefbe9-63f1-4cfe-a301-d109c6929fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d34f28-67aa-4f15-a052-fb78f0391907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d34f28-67aa-4f15-a052-fb78f0391907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-943665294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f85269-bc33-4903-92bf-1c02210fb18b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e9d540f4fa4350829595ffef6b7872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:41Z,use_quota=True,user_id='1ec8c595d5c54a2e93ea4493a3b787f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c732c7-32a4-4603-a249-75d6e7b07a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c732c7-32a4-4603-a249-75d6e7b07a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3208b46f-c0dc-4a52-af7a-4b55c8aa4a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3208b46f-c0dc-4a52-af7a-4b55c8aa4a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f85269-bc33-4903-92bf-1c02210fb18b', 'volume_name': 'volume-26f85269-bc33-4903-92bf-1c02210fb18b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf477f2c-c86b-4232-bf24-4811ff4a5be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf477f2c-c86b-4232-bf24-4811ff4a5be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:40 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675c1750-9430-4208-a026-8f6c68003cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:40 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Volume 26f85269-bc33-4903-92bf-1c02210fb18b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f85269-bc33-4903-92bf-1c02210fb18b', 'volume_size': 1} Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-943665294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f85269-bc33-4903-92bf-1c02210fb18b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e9d540f4fa4350829595ffef6b7872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:41Z,use_quota=True,user_id='1ec8c595d5c54a2e93ea4493a3b787f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Creating volume 26f85269-bc33-4903-92bf-1c02210fb18b {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:50:40 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:50:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-26f85269-bc33-4903-92bf-1c02210fb18b 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b730ab7-7a85-4088-9490-d042df3590f6_kb952wp4devstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-02b31773-5008-4a02-8edc-9f1487846061" returned: 0 in 2.413s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9b730ab7-7a85-4088-9490-d042df3590f6_kb952wp4devstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-02b31773-5008-4a02-8edc-9f1487846061 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:50:41 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Converted 112.00 MB image at 46.36 MB/s Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-02b31773-5008-4a02-8edc-9f1487846061 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:41 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-26f85269-bc33-4903-92bf-1c02210fb18b 1073741824 Nov 02 10:50:41 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:41 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-02b31773-5008-4a02-8edc-9f1487846061 1G Nov 02 10:50:41 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:41 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-02b31773-5008-4a02-8edc-9f1487846061 1G" returned: 0 in 0.360s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Downloaded image 9b730ab7-7a85-4088-9490-d042df3590f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/9b730ab7-7a85-4088-9490-d042df3590f6', 'metadata': {}}])) to volume 02b31773-5008-4a02-8edc-9f1487846061 successfully. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Temporary image 9b730ab7-7a85-4088-9490-d042df3590f6 for user 9d1611e597db4d078a6c71ca493afca2 is deleted. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Marking volume 02b31773-5008-4a02-8edc-9f1487846061 as bootable. {{(pid=87084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Copying metadata from image 9b730ab7-7a85-4088-9490-d042df3590f6 to 02b31773-5008-4a02-8edc-9f1487846061. {{(pid=87084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Creating volume glance metadata for volume 02b31773-5008-4a02-8edc-9f1487846061 backed by image 9b730ab7-7a85-4088-9490-d042df3590f6 with: {'image_id': '9b730ab7-7a85-4088-9490-d042df3590f6', 'image_name': 'tempest-scenario-img--219389391', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5cd9335-6f1c-44ec-b2c7-2b1f23460218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02b31773-5008-4a02-8edc-9f1487846061', 'volume_size': 1, 'image_id': '9b730ab7-7a85-4088-9490-d042df3590f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b730ab7-7a85-4088-9490-d042df3590f6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--219389391', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e688d33c3fc44d9d99ffae8948c055cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b730ab7-7a85-4088-9490-d042df3590f6', 'created_at': datetime.datetime(2026, 11, 2, 9, 50, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 50, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b730ab7-7a85-4088-9490-d042df3590f6/file', 'properties': {}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb5e2814-1d82-40a9-8886-43479f938ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Volume volume-02b31773-5008-4a02-8edc-9f1487846061 (02b31773-5008-4a02-8edc-9f1487846061): created successfully Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb5e2814-1d82-40a9-8886-43479f938ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Flow 'volume_create_manager' (83382fde-e15e-4acf-8ff7-08fb6368190c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:41 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-26f85269-bc33-4903-92bf-1c02210fb18b 1073741824" returned: 0 in 0.583s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f84db81c-3741-46dc-9c4c-0c50f86982b2 tempest-TestInstancesWithCinderVolumes-1565881454 None] Created volume successfully. Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-26f85269-bc33-4903-92bf-1c02210fb18b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:41 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-26f85269-bc33-4903-92bf-1c02210fb18b Nov 02 10:50:41 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:41 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-26f85269-bc33-4903-92bf-1c02210fb18b" returned: 0 in 0.267s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675c1750-9430-4208-a026-8f6c68003cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f85269-bc33-4903-92bf-1c02210fb18b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac4c4407-a5e1-49c4-8be6-818b734cb8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Volume volume-26f85269-bc33-4903-92bf-1c02210fb18b (26f85269-bc33-4903-92bf-1c02210fb18b): created successfully Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac4c4407-a5e1-49c4-8be6-818b734cb8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Flow 'volume_create_manager' (3aeefbe9-63f1-4cfe-a301-d109c6929fe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d8fdb4c8-593e-47de-a0eb-e1b38542eead tempest-VolumesTransfersV355Test-1153538416 None] Created volume successfully. Nov 02 10:50:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-28fa4044-abee-40fc-ad93-441a39b5af7e tempest-VolumesTransfersV355Test-1513767178 None] Transfer volume completed successfully. Nov 02 10:50:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-67e8a44e-1947-41b7-bcbd-f16384ec51a5 req-b535e39e-c4ca-416e-ab81-107059fa7f97 tempest-TestMinimumBasicScenario-893084461 None] Terminate volume connection completed successfully. Nov 02 10:50:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-67e8a44e-1947-41b7-bcbd-f16384ec51a5 req-b535e39e-c4ca-416e-ab81-107059fa7f97 tempest-TestMinimumBasicScenario-893084461 None] Deleting attachment c69d50ed-f716-4e38-9c20-6784b21d2be4. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:50:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-304714aa-d266-46de-a2d5-15ff92128715 tempest-VolumesTransfersV355Test-1913268736 None] Acquiring lock "cinder-26f85269-bc33-4903-92bf-1c02210fb18b-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-304714aa-d266-46de-a2d5-15ff92128715 tempest-VolumesTransfersV355Test-1913268736 None] Lock "cinder-26f85269-bc33-4903-92bf-1c02210fb18b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-304714aa-d266-46de-a2d5-15ff92128715 tempest-VolumesTransfersV355Test-1913268736 None] Acquiring lock "cinder-quobyte-26f85269-bc33-4903-92bf-1c02210fb18b" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-304714aa-d266-46de-a2d5-15ff92128715 tempest-VolumesTransfersV355Test-1913268736 None] Lock "cinder-quobyte-26f85269-bc33-4903-92bf-1c02210fb18b" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:45 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6596c4f2-a0ef-430a-afee-9a8a59ec7715]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-304714aa-d266-46de-a2d5-15ff92128715 tempest-VolumesTransfersV355Test-1913268736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-26f85269-bc33-4903-92bf-1c02210fb18b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:45 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-26f85269-bc33-4903-92bf-1c02210fb18b Nov 02 10:50:45 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-172aea48-c0ee-4002-9617-10ebc08bb6c1 tempest-TestMinimumBasicScenario-893084461 None] Acquiring lock "cinder-2b68e8ad-6e64-4a37-bf7e-a86114b903ca-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-172aea48-c0ee-4002-9617-10ebc08bb6c1 tempest-TestMinimumBasicScenario-893084461 None] Lock "cinder-2b68e8ad-6e64-4a37-bf7e-a86114b903ca-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:45 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-172aea48-c0ee-4002-9617-10ebc08bb6c1 tempest-TestMinimumBasicScenario-893084461 None] Acquiring lock "cinder-quobyte-2b68e8ad-6e64-4a37-bf7e-a86114b903ca" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-304714aa-d266-46de-a2d5-15ff92128715 tempest-VolumesTransfersV355Test-1913268736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-26f85269-bc33-4903-92bf-1c02210fb18b" returned: 0 in 0.629s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-304714aa-d266-46de-a2d5-15ff92128715 tempest-VolumesTransfersV355Test-1913268736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-26f85269-bc33-4903-92bf-1c02210fb18b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-172aea48-c0ee-4002-9617-10ebc08bb6c1 tempest-TestMinimumBasicScenario-893084461 None] Lock "cinder-quobyte-2b68e8ad-6e64-4a37-bf7e-a86114b903ca" acquired by "delete_volume" :: waited 0.034s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:45 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-26f85269-bc33-4903-92bf-1c02210fb18b Nov 02 10:50:45 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:45 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb811e9-5c94-4b99-99c4-f8e7201d139a]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-172aea48-c0ee-4002-9617-10ebc08bb6c1 tempest-TestMinimumBasicScenario-893084461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2b68e8ad-6e64-4a37-bf7e-a86114b903ca {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:46 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2b68e8ad-6e64-4a37-bf7e-a86114b903ca Nov 02 10:50:46 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:46 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-304714aa-d266-46de-a2d5-15ff92128715 tempest-VolumesTransfersV355Test-1913268736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-26f85269-bc33-4903-92bf-1c02210fb18b" returned: 0 in 0.468s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-304714aa-d266-46de-a2d5-15ff92128715 tempest-VolumesTransfersV355Test-1913268736 None] Lock "cinder-quobyte-26f85269-bc33-4903-92bf-1c02210fb18b" released by "delete_volume" :: held 1.176s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:46 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-304714aa-d266-46de-a2d5-15ff92128715 tempest-VolumesTransfersV355Test-1913268736 None] Created reservations ['eb96c057-c807-40da-ba09-c9795186d547', '522ef302-c135-46ad-8871-88d89028a16d', '21b92234-3dba-4e38-a47b-02767c676f41', '2fb3bfca-9123-4dde-82d6-9fc3a6e2e6f7'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:46 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-172aea48-c0ee-4002-9617-10ebc08bb6c1 tempest-TestMinimumBasicScenario-893084461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2b68e8ad-6e64-4a37-bf7e-a86114b903ca" returned: 0 in 0.540s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-172aea48-c0ee-4002-9617-10ebc08bb6c1 tempest-TestMinimumBasicScenario-893084461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2b68e8ad-6e64-4a37-bf7e-a86114b903ca {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:46 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2b68e8ad-6e64-4a37-bf7e-a86114b903ca Nov 02 10:50:46 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-304714aa-d266-46de-a2d5-15ff92128715 tempest-VolumesTransfersV355Test-1913268736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-304714aa-d266-46de-a2d5-15ff92128715 tempest-VolumesTransfersV355Test-1913268736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-304714aa-d266-46de-a2d5-15ff92128715 tempest-VolumesTransfersV355Test-1913268736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-304714aa-d266-46de-a2d5-15ff92128715 tempest-VolumesTransfersV355Test-1913268736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-304714aa-d266-46de-a2d5-15ff92128715 tempest-VolumesTransfersV355Test-1913268736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-304714aa-d266-46de-a2d5-15ff92128715 tempest-VolumesTransfersV355Test-1913268736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:46 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:50:46 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:46 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-172aea48-c0ee-4002-9617-10ebc08bb6c1 tempest-TestMinimumBasicScenario-893084461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2b68e8ad-6e64-4a37-bf7e-a86114b903ca" returned: 0 in 0.367s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-172aea48-c0ee-4002-9617-10ebc08bb6c1 tempest-TestMinimumBasicScenario-893084461 None] Lock "cinder-quobyte-2b68e8ad-6e64-4a37-bf7e-a86114b903ca" released by "delete_volume" :: held 0.976s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:46 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-172aea48-c0ee-4002-9617-10ebc08bb6c1 tempest-TestMinimumBasicScenario-893084461 None] Created reservations ['8c6c9d71-6b4a-45cb-aa35-a7bf4d7da64e', '4d2601b5-3283-441d-827b-0eb299134a84', '9fab4d0c-e138-4889-8e5e-fd82e657b2d5', 'af10537e-286f-4824-b6db-a9a8ff13acee'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:47 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-304714aa-d266-46de-a2d5-15ff92128715 tempest-VolumesTransfersV355Test-1913268736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.393s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:47 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-304714aa-d266-46de-a2d5-15ff92128715 tempest-VolumesTransfersV355Test-1913268736 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-304714aa-d266-46de-a2d5-15ff92128715 tempest-VolumesTransfersV355Test-1913268736 None] Deleted volume successfully. Nov 02 10:50:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-304714aa-d266-46de-a2d5-15ff92128715 tempest-VolumesTransfersV355Test-1913268736 None] Lock "cinder-26f85269-bc33-4903-92bf-1c02210fb18b-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-172aea48-c0ee-4002-9617-10ebc08bb6c1 tempest-TestMinimumBasicScenario-893084461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-172aea48-c0ee-4002-9617-10ebc08bb6c1 tempest-TestMinimumBasicScenario-893084461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-172aea48-c0ee-4002-9617-10ebc08bb6c1 tempest-TestMinimumBasicScenario-893084461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-172aea48-c0ee-4002-9617-10ebc08bb6c1 tempest-TestMinimumBasicScenario-893084461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-172aea48-c0ee-4002-9617-10ebc08bb6c1 tempest-TestMinimumBasicScenario-893084461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-172aea48-c0ee-4002-9617-10ebc08bb6c1 tempest-TestMinimumBasicScenario-893084461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:47 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:50:47 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:47 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-172aea48-c0ee-4002-9617-10ebc08bb6c1 tempest-TestMinimumBasicScenario-893084461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.434s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:47 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-172aea48-c0ee-4002-9617-10ebc08bb6c1 tempest-TestMinimumBasicScenario-893084461 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-172aea48-c0ee-4002-9617-10ebc08bb6c1 tempest-TestMinimumBasicScenario-893084461 None] Deleted volume successfully. Nov 02 10:50:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-172aea48-c0ee-4002-9617-10ebc08bb6c1 tempest-TestMinimumBasicScenario-893084461 None] Lock "cinder-2b68e8ad-6e64-4a37-bf7e-a86114b903ca-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-c585b242-9643-4f15-8c97-2fc30b72c40e req-7a662273-aaa5-4b3a-bac5-fdfa2ec5ed4a tempest-TestInstancesWithCinderVolumes-1565881454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-c585b242-9643-4f15-8c97-2fc30b72c40e req-7a662273-aaa5-4b3a-bac5-fdfa2ec5ed4a tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-c585b242-9643-4f15-8c97-2fc30b72c40e req-7a662273-aaa5-4b3a-bac5-fdfa2ec5ed4a tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-c585b242-9643-4f15-8c97-2fc30b72c40e req-7a662273-aaa5-4b3a-bac5-fdfa2ec5ed4a tempest-TestInstancesWithCinderVolumes-1565881454 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-02b31773-5008-4a02-8edc-9f1487846061', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11aed8cf-abbc-4e0c-89e3-cca0b9d11a51', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:50:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-c585b242-9643-4f15-8c97-2fc30b72c40e req-7a662273-aaa5-4b3a-bac5-fdfa2ec5ed4a tempest-TestInstancesWithCinderVolumes-1565881454 None] attachment_update completed successfully. Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Flow 'volume_create_manager' (089fe3f2-954e-46d4-970f-dbb5fbdd17dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152e3775-e9fb-4147-bd09-8a7956881049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152e3775-e9fb-4147-bd09-8a7956881049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-843951634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a8db10-7dc3-4da5-a3f0-325eae8ed758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e9d540f4fa4350829595ffef6b7872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:48Z,use_quota=True,user_id='1ec8c595d5c54a2e93ea4493a3b787f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f572568-2028-4df3-8a49-bab0048a4c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f572568-2028-4df3-8a49-bab0048a4c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56aa1a37-788f-4f15-948a-021040b6bbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56aa1a37-788f-4f15-948a-021040b6bbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27a8db10-7dc3-4da5-a3f0-325eae8ed758', 'volume_name': 'volume-27a8db10-7dc3-4da5-a3f0-325eae8ed758', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ae4f51-30b1-4a98-a3ef-f345437c095b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ae4f51-30b1-4a98-a3ef-f345437c095b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba0bd25-f2d3-4a95-8e99-6a167e7c6cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:48 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Volume 27a8db10-7dc3-4da5-a3f0-325eae8ed758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27a8db10-7dc3-4da5-a3f0-325eae8ed758', 'volume_size': 1} Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-843951634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a8db10-7dc3-4da5-a3f0-325eae8ed758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e9d540f4fa4350829595ffef6b7872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:48Z,use_quota=True,user_id='1ec8c595d5c54a2e93ea4493a3b787f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Creating volume 27a8db10-7dc3-4da5-a3f0-325eae8ed758 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:50:48 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:50:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-27a8db10-7dc3-4da5-a3f0-325eae8ed758 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:48 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-27a8db10-7dc3-4da5-a3f0-325eae8ed758 1073741824 Nov 02 10:50:48 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:49 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-27a8db10-7dc3-4da5-a3f0-325eae8ed758 1073741824" returned: 0 in 0.990s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-27a8db10-7dc3-4da5-a3f0-325eae8ed758 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:49 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-27a8db10-7dc3-4da5-a3f0-325eae8ed758 Nov 02 10:50:49 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:49 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-27a8db10-7dc3-4da5-a3f0-325eae8ed758" returned: 0 in 0.377s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:50:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba0bd25-f2d3-4a95-8e99-6a167e7c6cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27a8db10-7dc3-4da5-a3f0-325eae8ed758', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b09e3e-c24b-46e2-9877-1f339821a616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:49 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Volume volume-27a8db10-7dc3-4da5-a3f0-325eae8ed758 (27a8db10-7dc3-4da5-a3f0-325eae8ed758): created successfully Nov 02 10:50:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b09e3e-c24b-46e2-9877-1f339821a616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Flow 'volume_create_manager' (089fe3f2-954e-46d4-970f-dbb5fbdd17dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9a969ace-e500-460c-9f41-173bfab1b63b tempest-VolumesTransfersV355Test-1153538416 None] Created volume successfully. Nov 02 10:50:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-44fcfeef-d55c-4bf8-ad06-146822afd21f tempest-VolumesTransfersV355Test-1913268736 None] Acquiring lock "cinder-27a8db10-7dc3-4da5-a3f0-325eae8ed758-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-44fcfeef-d55c-4bf8-ad06-146822afd21f tempest-VolumesTransfersV355Test-1913268736 None] Lock "cinder-27a8db10-7dc3-4da5-a3f0-325eae8ed758-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-44fcfeef-d55c-4bf8-ad06-146822afd21f tempest-VolumesTransfersV355Test-1913268736 None] Acquiring lock "cinder-quobyte-27a8db10-7dc3-4da5-a3f0-325eae8ed758" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-44fcfeef-d55c-4bf8-ad06-146822afd21f tempest-VolumesTransfersV355Test-1913268736 None] Lock "cinder-quobyte-27a8db10-7dc3-4da5-a3f0-325eae8ed758" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:51 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b196d58d-a2a6-44d7-823b-25f3cee33522]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-44fcfeef-d55c-4bf8-ad06-146822afd21f tempest-VolumesTransfersV355Test-1913268736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-27a8db10-7dc3-4da5-a3f0-325eae8ed758 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:51 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-27a8db10-7dc3-4da5-a3f0-325eae8ed758 Nov 02 10:50:51 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:51 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-44fcfeef-d55c-4bf8-ad06-146822afd21f tempest-VolumesTransfersV355Test-1913268736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-27a8db10-7dc3-4da5-a3f0-325eae8ed758" returned: 0 in 0.597s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-44fcfeef-d55c-4bf8-ad06-146822afd21f tempest-VolumesTransfersV355Test-1913268736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-27a8db10-7dc3-4da5-a3f0-325eae8ed758 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:51 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-27a8db10-7dc3-4da5-a3f0-325eae8ed758 Nov 02 10:50:51 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:52 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-44fcfeef-d55c-4bf8-ad06-146822afd21f tempest-VolumesTransfersV355Test-1913268736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-27a8db10-7dc3-4da5-a3f0-325eae8ed758" returned: 0 in 0.572s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-44fcfeef-d55c-4bf8-ad06-146822afd21f tempest-VolumesTransfersV355Test-1913268736 None] Lock "cinder-quobyte-27a8db10-7dc3-4da5-a3f0-325eae8ed758" released by "delete_volume" :: held 1.256s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:52 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-44fcfeef-d55c-4bf8-ad06-146822afd21f tempest-VolumesTransfersV355Test-1913268736 None] Created reservations ['c9763f49-c30c-44b2-83b3-93f710a72d7f', '92627aad-2f91-4a8e-9a20-d98004656422', '46438c5b-93b0-4f81-b526-dd4bf1afda6d', 'c983c8e9-7b2c-4025-82bd-34d8e05b26c4'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-44fcfeef-d55c-4bf8-ad06-146822afd21f tempest-VolumesTransfersV355Test-1913268736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-44fcfeef-d55c-4bf8-ad06-146822afd21f tempest-VolumesTransfersV355Test-1913268736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-44fcfeef-d55c-4bf8-ad06-146822afd21f tempest-VolumesTransfersV355Test-1913268736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-44fcfeef-d55c-4bf8-ad06-146822afd21f tempest-VolumesTransfersV355Test-1913268736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-44fcfeef-d55c-4bf8-ad06-146822afd21f tempest-VolumesTransfersV355Test-1913268736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-44fcfeef-d55c-4bf8-ad06-146822afd21f tempest-VolumesTransfersV355Test-1913268736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:52 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:50:52 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:50:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:53 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-44fcfeef-d55c-4bf8-ad06-146822afd21f tempest-VolumesTransfersV355Test-1913268736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.480s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-44fcfeef-d55c-4bf8-ad06-146822afd21f tempest-VolumesTransfersV355Test-1913268736 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:53 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-44fcfeef-d55c-4bf8-ad06-146822afd21f tempest-VolumesTransfersV355Test-1913268736 None] Deleted volume successfully. Nov 02 10:50:53 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:50:53 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-44fcfeef-d55c-4bf8-ad06-146822afd21f tempest-VolumesTransfersV355Test-1913268736 None] Lock "cinder-27a8db10-7dc3-4da5-a3f0-325eae8ed758-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:53 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.591s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:50:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:50:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Flow 'volume_create_manager' (8bbac087-71de-4240-89ee-bc583804ac30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c0a423-8e49-4bbf-b31b-d4db18ab6b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c0a423-8e49-4bbf-b31b-d4db18ab6b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-394485617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93bdc03c-87e1-42f8-8113-3e637dff6299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad0554b1ba2c432f9d776b06cde93694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:02Z,use_quota=True,user_id='4477abb93e484129bfa652ec701dc3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1d200a-4330-4fb5-bc8c-66df455d948b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1d200a-4330-4fb5-bc8c-66df455d948b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b139591-607c-4e44-ba9e-b1975ce2d6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b139591-607c-4e44-ba9e-b1975ce2d6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93bdc03c-87e1-42f8-8113-3e637dff6299', 'volume_name': 'volume-93bdc03c-87e1-42f8-8113-3e637dff6299', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5c9868-a9b7-4616-94e1-36a970daef64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5c9868-a9b7-4616-94e1-36a970daef64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344101a0-42f6-489e-bb0d-9e94ebcb73d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:01 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Volume 93bdc03c-87e1-42f8-8113-3e637dff6299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93bdc03c-87e1-42f8-8113-3e637dff6299', 'volume_size': 1} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-394485617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93bdc03c-87e1-42f8-8113-3e637dff6299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad0554b1ba2c432f9d776b06cde93694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:02Z,use_quota=True,user_id='4477abb93e484129bfa652ec701dc3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Creating volume 93bdc03c-87e1-42f8-8113-3e637dff6299 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:51:01 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:51:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-93bdc03c-87e1-42f8-8113-3e637dff6299 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:01 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-93bdc03c-87e1-42f8-8113-3e637dff6299 1073741824 Nov 02 10:51:01 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:02 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-93bdc03c-87e1-42f8-8113-3e637dff6299 1073741824" returned: 0 in 0.669s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-93bdc03c-87e1-42f8-8113-3e637dff6299 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:02 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-93bdc03c-87e1-42f8-8113-3e637dff6299 Nov 02 10:51:02 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:03 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-93bdc03c-87e1-42f8-8113-3e637dff6299" returned: 0 in 0.586s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:51:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344101a0-42f6-489e-bb0d-9e94ebcb73d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93bdc03c-87e1-42f8-8113-3e637dff6299', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5f995c-34d4-43fe-8c73-3348b29b927e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:03 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Volume volume-93bdc03c-87e1-42f8-8113-3e637dff6299 (93bdc03c-87e1-42f8-8113-3e637dff6299): created successfully Nov 02 10:51:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5f995c-34d4-43fe-8c73-3348b29b927e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Flow 'volume_create_manager' (8bbac087-71de-4240-89ee-bc583804ac30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9a3221d3-d143-4d9f-b2bc-a60691262921 tempest-VolumesListAdminTestJSON-1942000664 None] Created volume successfully. Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Flow 'volume_create_manager' (aae826f8-23da-48d1-a5da-9ea81b7cef6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591013b5-ad31-452b-af99-5801ee6b9d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591013b5-ad31-452b-af99-5801ee6b9d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1374394717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23821daa-36d8-4dae-be54-174475cb5f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad0554b1ba2c432f9d776b06cde93694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:05Z,use_quota=True,user_id='4477abb93e484129bfa652ec701dc3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c480533-b77b-462f-b577-570fb62c9ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c480533-b77b-462f-b577-570fb62c9ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9189f4bd-63c7-4383-8d4b-00f211bef343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9189f4bd-63c7-4383-8d4b-00f211bef343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23821daa-36d8-4dae-be54-174475cb5f9a', 'volume_name': 'volume-23821daa-36d8-4dae-be54-174475cb5f9a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c5f5bd-f78b-419b-9822-fcc1e327ef52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c5f5bd-f78b-419b-9822-fcc1e327ef52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46b166b-23d8-40a1-9d5b-eafb90aa24b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:04 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Volume 23821daa-36d8-4dae-be54-174475cb5f9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23821daa-36d8-4dae-be54-174475cb5f9a', 'volume_size': 1} Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1374394717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23821daa-36d8-4dae-be54-174475cb5f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad0554b1ba2c432f9d776b06cde93694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:05Z,use_quota=True,user_id='4477abb93e484129bfa652ec701dc3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Creating volume 23821daa-36d8-4dae-be54-174475cb5f9a {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:51:04 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:51:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-23821daa-36d8-4dae-be54-174475cb5f9a 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:04 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-23821daa-36d8-4dae-be54-174475cb5f9a 1073741824 Nov 02 10:51:04 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:05 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-23821daa-36d8-4dae-be54-174475cb5f9a 1073741824" returned: 0 in 0.627s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-23821daa-36d8-4dae-be54-174475cb5f9a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:05 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-23821daa-36d8-4dae-be54-174475cb5f9a Nov 02 10:51:05 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:06 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-23821daa-36d8-4dae-be54-174475cb5f9a" returned: 0 in 0.569s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:51:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46b166b-23d8-40a1-9d5b-eafb90aa24b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23821daa-36d8-4dae-be54-174475cb5f9a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61a90cd-cee3-4d34-8e40-098b87544f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:06 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Volume volume-23821daa-36d8-4dae-be54-174475cb5f9a (23821daa-36d8-4dae-be54-174475cb5f9a): created successfully Nov 02 10:51:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61a90cd-cee3-4d34-8e40-098b87544f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Flow 'volume_create_manager' (aae826f8-23da-48d1-a5da-9ea81b7cef6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:06 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b7a147da-afad-463a-bbf8-47db3e9fd99f tempest-VolumesListAdminTestJSON-1942000664 None] Created volume successfully. Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Flow 'volume_create_manager' (556442a1-553e-46ea-90b9-cad92f85fe5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e443c4cb-7a5a-4004-bf07-95ca1439defe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e443c4cb-7a5a-4004-bf07-95ca1439defe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-715360139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9650efae-bc2c-4a94-bcac-555e1d1552e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad0554b1ba2c432f9d776b06cde93694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:08Z,use_quota=True,user_id='4477abb93e484129bfa652ec701dc3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe5ea32-35de-4aa9-b091-fb1b047dca05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe5ea32-35de-4aa9-b091-fb1b047dca05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef6b4ac-53d3-49bb-b6cc-c573d4f0798a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef6b4ac-53d3-49bb-b6cc-c573d4f0798a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9650efae-bc2c-4a94-bcac-555e1d1552e4', 'volume_name': 'volume-9650efae-bc2c-4a94-bcac-555e1d1552e4', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdffc76d-6b41-4b05-ab41-f6d5910d8425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdffc76d-6b41-4b05-ab41-f6d5910d8425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb7759d-dac5-4c54-bd4f-bb8e9af574d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:07 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Volume 9650efae-bc2c-4a94-bcac-555e1d1552e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9650efae-bc2c-4a94-bcac-555e1d1552e4', 'volume_size': 1} Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-715360139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9650efae-bc2c-4a94-bcac-555e1d1552e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad0554b1ba2c432f9d776b06cde93694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:08Z,use_quota=True,user_id='4477abb93e484129bfa652ec701dc3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Creating volume 9650efae-bc2c-4a94-bcac-555e1d1552e4 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:51:07 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:51:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9650efae-bc2c-4a94-bcac-555e1d1552e4 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:07 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9650efae-bc2c-4a94-bcac-555e1d1552e4 1073741824 Nov 02 10:51:07 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:08 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9650efae-bc2c-4a94-bcac-555e1d1552e4 1073741824" returned: 0 in 0.995s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9650efae-bc2c-4a94-bcac-555e1d1552e4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:08 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9650efae-bc2c-4a94-bcac-555e1d1552e4 Nov 02 10:51:08 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:09 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9650efae-bc2c-4a94-bcac-555e1d1552e4" returned: 0 in 0.649s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:51:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb7759d-dac5-4c54-bd4f-bb8e9af574d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9650efae-bc2c-4a94-bcac-555e1d1552e4', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2870ad8c-7ca7-4482-9876-6562231c9b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:09 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Volume volume-9650efae-bc2c-4a94-bcac-555e1d1552e4 (9650efae-bc2c-4a94-bcac-555e1d1552e4): created successfully Nov 02 10:51:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2870ad8c-7ca7-4482-9876-6562231c9b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Flow 'volume_create_manager' (556442a1-553e-46ea-90b9-cad92f85fe5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:09 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-863fc8c5-2018-4d86-a0b7-30a1c4d25b98 tempest-VolumesListAdminTestJSON-1942000664 None] Created volume successfully. Nov 02 10:51:09 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:51:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Flow 'volume_create_manager' (796b08ab-7bd4-4fcd-a9af-ddaa09595714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb6ba8c-eee5-4f68-bf1c-084c20d8cedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb6ba8c-eee5-4f68-bf1c-084c20d8cedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-410321886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06e4465-3073-4228-af07-531f833a7049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b86324f12f44cc6a9786242adf01b6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:10Z,use_quota=True,user_id='05bf8b2825bf482482b704f476862afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5166467e-849b-4b10-b3c8-622ed0d7c7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5166467e-849b-4b10-b3c8-622ed0d7c7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0424be1-4591-405d-8dca-36778b67ed54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0424be1-4591-405d-8dca-36778b67ed54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b06e4465-3073-4228-af07-531f833a7049', 'volume_name': 'volume-b06e4465-3073-4228-af07-531f833a7049', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e98960f-a91a-462a-8623-8d609fabf175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e98960f-a91a-462a-8623-8d609fabf175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c009ba0b-1336-421a-a6e4-ee4d2ac522be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:10 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Volume b06e4465-3073-4228-af07-531f833a7049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b06e4465-3073-4228-af07-531f833a7049', 'volume_size': 1} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-410321886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06e4465-3073-4228-af07-531f833a7049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b86324f12f44cc6a9786242adf01b6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:10Z,use_quota=True,user_id='05bf8b2825bf482482b704f476862afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Creating volume b06e4465-3073-4228-af07-531f833a7049 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:51:10 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b06e4465-3073-4228-af07-531f833a7049 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:10 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b06e4465-3073-4228-af07-531f833a7049 1073741824 Nov 02 10:51:10 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:10 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b06e4465-3073-4228-af07-531f833a7049 1073741824" returned: 0 in 0.507s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b06e4465-3073-4228-af07-531f833a7049 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:10 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b06e4465-3073-4228-af07-531f833a7049 Nov 02 10:51:10 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:10 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b06e4465-3073-4228-af07-531f833a7049" returned: 0 in 0.335s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c009ba0b-1336-421a-a6e4-ee4d2ac522be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b06e4465-3073-4228-af07-531f833a7049', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8a8b3e-c6cf-40b7-a4e7-561731c813e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:10 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Volume volume-b06e4465-3073-4228-af07-531f833a7049 (b06e4465-3073-4228-af07-531f833a7049): created successfully Nov 02 10:51:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8a8b3e-c6cf-40b7-a4e7-561731c813e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Flow 'volume_create_manager' (796b08ab-7bd4-4fcd-a9af-ddaa09595714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:11 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9b3519fd-b693-41c9-8353-28699eb5fe75 tempest-VolumesTransfersV357Test-1293540121 None] Created volume successfully. Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Flow 'volume_create_manager' (f5ef08fa-6841-49bb-8726-92f18de8a757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed1ccc1-72eb-43a3-b39d-f15be6d17545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed1ccc1-72eb-43a3-b39d-f15be6d17545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9596600-b211-49de-9601-2e17ac7b0baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995af397c3dd4ac19d57769b3ed5ab6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:12Z,use_quota=True,user_id='623c0a48e4df44abba20efdf31f13db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6412857-e534-41fd-a700-9b907106ad31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6412857-e534-41fd-a700-9b907106ad31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40785ebf-733e-4f67-82d9-a28a33fd3e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40785ebf-733e-4f67-82d9-a28a33fd3e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9596600-b211-49de-9601-2e17ac7b0baf', 'volume_name': 'volume-b9596600-b211-49de-9601-2e17ac7b0baf', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (682db6d1-cc8b-4a9a-a9d3-7f1bc8823fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (682db6d1-cc8b-4a9a-a9d3-7f1bc8823fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9aa069-d909-463f-a632-15e2c5d22b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:12 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Volume b9596600-b211-49de-9601-2e17ac7b0baf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9596600-b211-49de-9601-2e17ac7b0baf', 'volume_size': 1} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9596600-b211-49de-9601-2e17ac7b0baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995af397c3dd4ac19d57769b3ed5ab6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:12Z,use_quota=True,user_id='623c0a48e4df44abba20efdf31f13db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Creating volume b9596600-b211-49de-9601-2e17ac7b0baf {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:51:12 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9596600-b211-49de-9601-2e17ac7b0baf 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:12 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9596600-b211-49de-9601-2e17ac7b0baf 1073741824 Nov 02 10:51:12 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:12 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9596600-b211-49de-9601-2e17ac7b0baf 1073741824" returned: 0 in 0.588s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9596600-b211-49de-9601-2e17ac7b0baf {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:12 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9596600-b211-49de-9601-2e17ac7b0baf Nov 02 10:51:12 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:13 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9596600-b211-49de-9601-2e17ac7b0baf" returned: 0 in 0.309s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:51:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9aa069-d909-463f-a632-15e2c5d22b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9596600-b211-49de-9601-2e17ac7b0baf', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f08789-865f-4858-9e32-18176b84c3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:13 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Volume volume-b9596600-b211-49de-9601-2e17ac7b0baf (b9596600-b211-49de-9601-2e17ac7b0baf): created successfully Nov 02 10:51:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f08789-865f-4858-9e32-18176b84c3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Flow 'volume_create_manager' (f5ef08fa-6841-49bb-8726-92f18de8a757) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:13 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-48f12b78-18b2-42d2-aa70-0c1164b255b4 tempest-VolumesListAdminTestJSON-505657453 None] Created volume successfully. Nov 02 10:51:13 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7a541631-f39f-4d07-bfa8-7f2e98a4bc41 tempest-VolumesTransfersV357Test-1240159592 None] Transfer volume completed successfully. Nov 02 10:51:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-db1dd8e2-d5c5-414b-82b7-156ef7877b75 tempest-VolumesTransfersV357Test-1069822683 None] Acquiring lock "cinder-b06e4465-3073-4228-af07-531f833a7049-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-db1dd8e2-d5c5-414b-82b7-156ef7877b75 tempest-VolumesTransfersV357Test-1069822683 None] Lock "cinder-b06e4465-3073-4228-af07-531f833a7049-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-db1dd8e2-d5c5-414b-82b7-156ef7877b75 tempest-VolumesTransfersV357Test-1069822683 None] Acquiring lock "cinder-quobyte-b06e4465-3073-4228-af07-531f833a7049" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-db1dd8e2-d5c5-414b-82b7-156ef7877b75 tempest-VolumesTransfersV357Test-1069822683 None] Lock "cinder-quobyte-b06e4465-3073-4228-af07-531f833a7049" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[930cbf74-c75a-480a-b887-d11520f2f054]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db1dd8e2-d5c5-414b-82b7-156ef7877b75 tempest-VolumesTransfersV357Test-1069822683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b06e4465-3073-4228-af07-531f833a7049 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:14 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b06e4465-3073-4228-af07-531f833a7049 Nov 02 10:51:14 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6c4aea0e-932c-42ed-8144-dfd9c20ea2e8 tempest-VolumesListAdminTestJSON-505657453 None] Acquiring lock "cinder-b9596600-b211-49de-9601-2e17ac7b0baf-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6c4aea0e-932c-42ed-8144-dfd9c20ea2e8 tempest-VolumesListAdminTestJSON-505657453 None] Lock "cinder-b9596600-b211-49de-9601-2e17ac7b0baf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6c4aea0e-932c-42ed-8144-dfd9c20ea2e8 tempest-VolumesListAdminTestJSON-505657453 None] Acquiring lock "cinder-quobyte-b9596600-b211-49de-9601-2e17ac7b0baf" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6c4aea0e-932c-42ed-8144-dfd9c20ea2e8 tempest-VolumesListAdminTestJSON-505657453 None] Lock "cinder-quobyte-b9596600-b211-49de-9601-2e17ac7b0baf" acquired by "delete_volume" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5377196-5897-4c4d-8cd3-6da3f788b3db]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6c4aea0e-932c-42ed-8144-dfd9c20ea2e8 tempest-VolumesListAdminTestJSON-505657453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9596600-b211-49de-9601-2e17ac7b0baf {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8a39f5f6-5c79-486a-913d-58936764cdb5 tempest-VolumesListAdminTestJSON-1942000664 None] Acquiring lock "cinder-9650efae-bc2c-4a94-bcac-555e1d1552e4-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8a39f5f6-5c79-486a-913d-58936764cdb5 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "cinder-9650efae-bc2c-4a94-bcac-555e1d1552e4-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:14 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:14 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9596600-b211-49de-9601-2e17ac7b0baf Nov 02 10:51:14 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db1dd8e2-d5c5-414b-82b7-156ef7877b75 tempest-VolumesTransfersV357Test-1069822683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b06e4465-3073-4228-af07-531f833a7049" returned: 0 in 0.562s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db1dd8e2-d5c5-414b-82b7-156ef7877b75 tempest-VolumesTransfersV357Test-1069822683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b06e4465-3073-4228-af07-531f833a7049 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8a39f5f6-5c79-486a-913d-58936764cdb5 tempest-VolumesListAdminTestJSON-1942000664 None] Acquiring lock "cinder-quobyte-9650efae-bc2c-4a94-bcac-555e1d1552e4" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:14 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b06e4465-3073-4228-af07-531f833a7049 Nov 02 10:51:14 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8a39f5f6-5c79-486a-913d-58936764cdb5 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "cinder-quobyte-9650efae-bc2c-4a94-bcac-555e1d1552e4" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb86c47-b71a-410c-a69e-cfb9c2be2628]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8a39f5f6-5c79-486a-913d-58936764cdb5 tempest-VolumesListAdminTestJSON-1942000664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9650efae-bc2c-4a94-bcac-555e1d1552e4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:14 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9650efae-bc2c-4a94-bcac-555e1d1552e4 Nov 02 10:51:14 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:14 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db1dd8e2-d5c5-414b-82b7-156ef7877b75 tempest-VolumesTransfersV357Test-1069822683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b06e4465-3073-4228-af07-531f833a7049" returned: 0 in 0.323s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:14 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6c4aea0e-932c-42ed-8144-dfd9c20ea2e8 tempest-VolumesListAdminTestJSON-505657453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9596600-b211-49de-9601-2e17ac7b0baf" returned: 0 in 0.545s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6c4aea0e-932c-42ed-8144-dfd9c20ea2e8 tempest-VolumesListAdminTestJSON-505657453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9596600-b211-49de-9601-2e17ac7b0baf {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-db1dd8e2-d5c5-414b-82b7-156ef7877b75 tempest-VolumesTransfersV357Test-1069822683 None] Lock "cinder-quobyte-b06e4465-3073-4228-af07-531f833a7049" released by "delete_volume" :: held 0.948s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:14 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9596600-b211-49de-9601-2e17ac7b0baf Nov 02 10:51:14 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-db1dd8e2-d5c5-414b-82b7-156ef7877b75 tempest-VolumesTransfersV357Test-1069822683 None] Created reservations ['f5d3d81f-8a8b-4d21-befb-9c0196779eda', '2247ac56-6f38-4a9d-8472-36d10e6f6c7a', 'cf864375-9cc3-4788-8438-8c19382d92c1', '3d1a045a-d9dd-4cde-abc5-a97d0cc18cf3'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-db1dd8e2-d5c5-414b-82b7-156ef7877b75 tempest-VolumesTransfersV357Test-1069822683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-db1dd8e2-d5c5-414b-82b7-156ef7877b75 tempest-VolumesTransfersV357Test-1069822683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-db1dd8e2-d5c5-414b-82b7-156ef7877b75 tempest-VolumesTransfersV357Test-1069822683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-db1dd8e2-d5c5-414b-82b7-156ef7877b75 tempest-VolumesTransfersV357Test-1069822683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-db1dd8e2-d5c5-414b-82b7-156ef7877b75 tempest-VolumesTransfersV357Test-1069822683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db1dd8e2-d5c5-414b-82b7-156ef7877b75 tempest-VolumesTransfersV357Test-1069822683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:15 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:51:15 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:15 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8a39f5f6-5c79-486a-913d-58936764cdb5 tempest-VolumesListAdminTestJSON-1942000664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9650efae-bc2c-4a94-bcac-555e1d1552e4" returned: 0 in 0.475s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8a39f5f6-5c79-486a-913d-58936764cdb5 tempest-VolumesListAdminTestJSON-1942000664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9650efae-bc2c-4a94-bcac-555e1d1552e4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:15 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9650efae-bc2c-4a94-bcac-555e1d1552e4 Nov 02 10:51:15 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:15 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6c4aea0e-932c-42ed-8144-dfd9c20ea2e8 tempest-VolumesListAdminTestJSON-505657453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9596600-b211-49de-9601-2e17ac7b0baf" returned: 0 in 0.355s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6c4aea0e-932c-42ed-8144-dfd9c20ea2e8 tempest-VolumesListAdminTestJSON-505657453 None] Lock "cinder-quobyte-b9596600-b211-49de-9601-2e17ac7b0baf" released by "delete_volume" :: held 0.964s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-6c4aea0e-932c-42ed-8144-dfd9c20ea2e8 tempest-VolumesListAdminTestJSON-505657453 None] Created reservations ['57edde59-a07e-48fb-9889-654d34495932', '7b059878-1bfa-42a5-bee0-8eb792fc80e8', 'fe804c2a-9f75-4151-b7d3-510f651d1afa', '9fad4ecf-1787-48fb-9c99-8ae43e10dda5'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:15 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db1dd8e2-d5c5-414b-82b7-156ef7877b75 tempest-VolumesTransfersV357Test-1069822683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.315s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-db1dd8e2-d5c5-414b-82b7-156ef7877b75 tempest-VolumesTransfersV357Test-1069822683 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:51:15 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-db1dd8e2-d5c5-414b-82b7-156ef7877b75 tempest-VolumesTransfersV357Test-1069822683 None] Deleted volume successfully. Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6c4aea0e-932c-42ed-8144-dfd9c20ea2e8 tempest-VolumesListAdminTestJSON-505657453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6c4aea0e-932c-42ed-8144-dfd9c20ea2e8 tempest-VolumesListAdminTestJSON-505657453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6c4aea0e-932c-42ed-8144-dfd9c20ea2e8 tempest-VolumesListAdminTestJSON-505657453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6c4aea0e-932c-42ed-8144-dfd9c20ea2e8 tempest-VolumesListAdminTestJSON-505657453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6c4aea0e-932c-42ed-8144-dfd9c20ea2e8 tempest-VolumesListAdminTestJSON-505657453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6c4aea0e-932c-42ed-8144-dfd9c20ea2e8 tempest-VolumesListAdminTestJSON-505657453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:15 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:51:15 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-db1dd8e2-d5c5-414b-82b7-156ef7877b75 tempest-VolumesTransfersV357Test-1069822683 None] Lock "cinder-b06e4465-3073-4228-af07-531f833a7049-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:15 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8a39f5f6-5c79-486a-913d-58936764cdb5 tempest-VolumesListAdminTestJSON-1942000664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9650efae-bc2c-4a94-bcac-555e1d1552e4" returned: 0 in 0.324s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8a39f5f6-5c79-486a-913d-58936764cdb5 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "cinder-quobyte-9650efae-bc2c-4a94-bcac-555e1d1552e4" released by "delete_volume" :: held 0.878s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-8a39f5f6-5c79-486a-913d-58936764cdb5 tempest-VolumesListAdminTestJSON-1942000664 None] Created reservations ['12e27c32-cad0-4e0d-bf01-3d921bbbc457', 'a0b42e09-c073-46df-ac33-b379d31912f0', '98e9ac4b-6b57-4c6c-be12-aa57fcd00db2', 'ea8f8af8-3ef6-4241-9f35-cd3c4a68e721'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8a39f5f6-5c79-486a-913d-58936764cdb5 tempest-VolumesListAdminTestJSON-1942000664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8a39f5f6-5c79-486a-913d-58936764cdb5 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8a39f5f6-5c79-486a-913d-58936764cdb5 tempest-VolumesListAdminTestJSON-1942000664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8a39f5f6-5c79-486a-913d-58936764cdb5 tempest-VolumesListAdminTestJSON-1942000664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8a39f5f6-5c79-486a-913d-58936764cdb5 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8a39f5f6-5c79-486a-913d-58936764cdb5 tempest-VolumesListAdminTestJSON-1942000664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:15 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:51:15 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:15 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6c4aea0e-932c-42ed-8144-dfd9c20ea2e8 tempest-VolumesListAdminTestJSON-505657453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.328s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-6c4aea0e-932c-42ed-8144-dfd9c20ea2e8 tempest-VolumesListAdminTestJSON-505657453 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:51:15 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6c4aea0e-932c-42ed-8144-dfd9c20ea2e8 tempest-VolumesListAdminTestJSON-505657453 None] Deleted volume successfully. Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6c4aea0e-932c-42ed-8144-dfd9c20ea2e8 tempest-VolumesListAdminTestJSON-505657453 None] Lock "cinder-b9596600-b211-49de-9601-2e17ac7b0baf-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-608a5d86-ccdd-4db5-9325-97f2a0948684 tempest-VolumesListAdminTestJSON-1942000664 None] Acquiring lock "cinder-23821daa-36d8-4dae-be54-174475cb5f9a-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-608a5d86-ccdd-4db5-9325-97f2a0948684 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "cinder-23821daa-36d8-4dae-be54-174475cb5f9a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-608a5d86-ccdd-4db5-9325-97f2a0948684 tempest-VolumesListAdminTestJSON-1942000664 None] Acquiring lock "cinder-quobyte-23821daa-36d8-4dae-be54-174475cb5f9a" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-608a5d86-ccdd-4db5-9325-97f2a0948684 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "cinder-quobyte-23821daa-36d8-4dae-be54-174475cb5f9a" acquired by "delete_volume" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30b447f-46f1-4270-89be-d63a035ea3c7]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-608a5d86-ccdd-4db5-9325-97f2a0948684 tempest-VolumesListAdminTestJSON-1942000664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-23821daa-36d8-4dae-be54-174475cb5f9a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:16 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8a39f5f6-5c79-486a-913d-58936764cdb5 tempest-VolumesListAdminTestJSON-1942000664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.340s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-8a39f5f6-5c79-486a-913d-58936764cdb5 tempest-VolumesListAdminTestJSON-1942000664 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:51:16 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8a39f5f6-5c79-486a-913d-58936764cdb5 tempest-VolumesListAdminTestJSON-1942000664 None] Deleted volume successfully. Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8a39f5f6-5c79-486a-913d-58936764cdb5 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "cinder-9650efae-bc2c-4a94-bcac-555e1d1552e4-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:16 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-23821daa-36d8-4dae-be54-174475cb5f9a Nov 02 10:51:16 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:16 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-608a5d86-ccdd-4db5-9325-97f2a0948684 tempest-VolumesListAdminTestJSON-1942000664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-23821daa-36d8-4dae-be54-174475cb5f9a" returned: 0 in 0.382s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-608a5d86-ccdd-4db5-9325-97f2a0948684 tempest-VolumesListAdminTestJSON-1942000664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-23821daa-36d8-4dae-be54-174475cb5f9a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:16 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-23821daa-36d8-4dae-be54-174475cb5f9a Nov 02 10:51:16 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:16 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-608a5d86-ccdd-4db5-9325-97f2a0948684 tempest-VolumesListAdminTestJSON-1942000664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-23821daa-36d8-4dae-be54-174475cb5f9a" returned: 0 in 0.268s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-608a5d86-ccdd-4db5-9325-97f2a0948684 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "cinder-quobyte-23821daa-36d8-4dae-be54-174475cb5f9a" released by "delete_volume" :: held 0.704s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-608a5d86-ccdd-4db5-9325-97f2a0948684 tempest-VolumesListAdminTestJSON-1942000664 None] Created reservations ['08f19a23-09b7-4395-9916-87ca2c1ed828', 'ff64696c-5f1e-40ee-85bc-4af8ed627339', 'a8c2e2e8-6cbe-4b6c-9e32-c32771f3d20e', 'd4244f42-c465-4494-94c2-56fece29b063'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Flow 'volume_create_manager' (ccc4951e-31a1-4c54-8ddd-71b7a6ca6636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e6c067-be0c-4760-bf2a-d62d7cf57dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e6c067-be0c-4760-bf2a-d62d7cf57dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1701628926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a09b86a7-9b53-4462-9f12-1513459a5fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b86324f12f44cc6a9786242adf01b6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:17Z,use_quota=True,user_id='05bf8b2825bf482482b704f476862afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f18fc8-ebaf-4147-8461-956161756550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f18fc8-ebaf-4147-8461-956161756550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b806d691-ba86-4b9e-8fc5-38421b17c242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b806d691-ba86-4b9e-8fc5-38421b17c242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a09b86a7-9b53-4462-9f12-1513459a5fbf', 'volume_name': 'volume-a09b86a7-9b53-4462-9f12-1513459a5fbf', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8741949-4cf1-49e3-a643-5964ad26709e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8741949-4cf1-49e3-a643-5964ad26709e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b625ce-f53d-460b-b9be-51a291f71b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:16 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Volume a09b86a7-9b53-4462-9f12-1513459a5fbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a09b86a7-9b53-4462-9f12-1513459a5fbf', 'volume_size': 1} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1701628926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a09b86a7-9b53-4462-9f12-1513459a5fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b86324f12f44cc6a9786242adf01b6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:17Z,use_quota=True,user_id='05bf8b2825bf482482b704f476862afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Creating volume a09b86a7-9b53-4462-9f12-1513459a5fbf {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:51:16 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a09b86a7-9b53-4462-9f12-1513459a5fbf 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:16 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a09b86a7-9b53-4462-9f12-1513459a5fbf 1073741824 Nov 02 10:51:16 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-608a5d86-ccdd-4db5-9325-97f2a0948684 tempest-VolumesListAdminTestJSON-1942000664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-608a5d86-ccdd-4db5-9325-97f2a0948684 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-608a5d86-ccdd-4db5-9325-97f2a0948684 tempest-VolumesListAdminTestJSON-1942000664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-608a5d86-ccdd-4db5-9325-97f2a0948684 tempest-VolumesListAdminTestJSON-1942000664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-608a5d86-ccdd-4db5-9325-97f2a0948684 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-608a5d86-ccdd-4db5-9325-97f2a0948684 tempest-VolumesListAdminTestJSON-1942000664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:16 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:51:16 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-efb92df4-091c-45a7-84f2-9a2d10052e42 tempest-VolumesListAdminTestJSON-1942000664 None] Acquiring lock "cinder-93bdc03c-87e1-42f8-8113-3e637dff6299-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-efb92df4-091c-45a7-84f2-9a2d10052e42 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "cinder-93bdc03c-87e1-42f8-8113-3e637dff6299-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:17 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-608a5d86-ccdd-4db5-9325-97f2a0948684 tempest-VolumesListAdminTestJSON-1942000664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.342s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:17 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-608a5d86-ccdd-4db5-9325-97f2a0948684 tempest-VolumesListAdminTestJSON-1942000664 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:51:17 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-608a5d86-ccdd-4db5-9325-97f2a0948684 tempest-VolumesListAdminTestJSON-1942000664 None] Deleted volume successfully. Nov 02 10:51:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-efb92df4-091c-45a7-84f2-9a2d10052e42 tempest-VolumesListAdminTestJSON-1942000664 None] Acquiring lock "cinder-quobyte-93bdc03c-87e1-42f8-8113-3e637dff6299" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-608a5d86-ccdd-4db5-9325-97f2a0948684 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "cinder-23821daa-36d8-4dae-be54-174475cb5f9a-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-efb92df4-091c-45a7-84f2-9a2d10052e42 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "cinder-quobyte-93bdc03c-87e1-42f8-8113-3e637dff6299" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:17 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c4b378-0146-4d98-86f0-cc6febbaea76]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-efb92df4-091c-45a7-84f2-9a2d10052e42 tempest-VolumesListAdminTestJSON-1942000664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-93bdc03c-87e1-42f8-8113-3e637dff6299 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:17 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a09b86a7-9b53-4462-9f12-1513459a5fbf 1073741824" returned: 0 in 0.610s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:17 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-93bdc03c-87e1-42f8-8113-3e637dff6299 Nov 02 10:51:17 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a09b86a7-9b53-4462-9f12-1513459a5fbf {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:17 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a09b86a7-9b53-4462-9f12-1513459a5fbf Nov 02 10:51:17 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:17 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-efb92df4-091c-45a7-84f2-9a2d10052e42 tempest-VolumesListAdminTestJSON-1942000664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-93bdc03c-87e1-42f8-8113-3e637dff6299" returned: 0 in 0.417s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-efb92df4-091c-45a7-84f2-9a2d10052e42 tempest-VolumesListAdminTestJSON-1942000664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-93bdc03c-87e1-42f8-8113-3e637dff6299 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:17 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a09b86a7-9b53-4462-9f12-1513459a5fbf" returned: 0 in 0.278s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:51:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:17 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-93bdc03c-87e1-42f8-8113-3e637dff6299 Nov 02 10:51:17 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b625ce-f53d-460b-b9be-51a291f71b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a09b86a7-9b53-4462-9f12-1513459a5fbf', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e05ee3a-b316-412a-aaac-f27d5a771fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:17 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Volume volume-a09b86a7-9b53-4462-9f12-1513459a5fbf (a09b86a7-9b53-4462-9f12-1513459a5fbf): created successfully Nov 02 10:51:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e05ee3a-b316-412a-aaac-f27d5a771fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Flow 'volume_create_manager' (ccc4951e-31a1-4c54-8ddd-71b7a6ca6636) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:17 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-15571f1c-c15b-4bb8-b5f6-4988f43c46e6 tempest-VolumesTransfersV357Test-1293540121 None] Created volume successfully. Nov 02 10:51:18 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-efb92df4-091c-45a7-84f2-9a2d10052e42 tempest-VolumesListAdminTestJSON-1942000664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-93bdc03c-87e1-42f8-8113-3e637dff6299" returned: 0 in 0.268s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-efb92df4-091c-45a7-84f2-9a2d10052e42 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "cinder-quobyte-93bdc03c-87e1-42f8-8113-3e637dff6299" released by "delete_volume" :: held 0.738s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:18 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-efb92df4-091c-45a7-84f2-9a2d10052e42 tempest-VolumesListAdminTestJSON-1942000664 None] Created reservations ['93c577e0-b5b1-47a0-b26b-93fa2e67a2d2', 'cf652e2a-5d07-4f37-813b-24296ea97353', '87f5a8c9-a6ec-446e-9a9b-fd9a17445735', '396bf236-7930-46b3-8fcd-9230c32ef2d2'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-efb92df4-091c-45a7-84f2-9a2d10052e42 tempest-VolumesListAdminTestJSON-1942000664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-efb92df4-091c-45a7-84f2-9a2d10052e42 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-efb92df4-091c-45a7-84f2-9a2d10052e42 tempest-VolumesListAdminTestJSON-1942000664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-efb92df4-091c-45a7-84f2-9a2d10052e42 tempest-VolumesListAdminTestJSON-1942000664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-efb92df4-091c-45a7-84f2-9a2d10052e42 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-efb92df4-091c-45a7-84f2-9a2d10052e42 tempest-VolumesListAdminTestJSON-1942000664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:18 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:51:18 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:18 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-efb92df4-091c-45a7-84f2-9a2d10052e42 tempest-VolumesListAdminTestJSON-1942000664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.310s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:18 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-efb92df4-091c-45a7-84f2-9a2d10052e42 tempest-VolumesListAdminTestJSON-1942000664 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:51:18 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-efb92df4-091c-45a7-84f2-9a2d10052e42 tempest-VolumesListAdminTestJSON-1942000664 None] Deleted volume successfully. Nov 02 10:51:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-efb92df4-091c-45a7-84f2-9a2d10052e42 tempest-VolumesListAdminTestJSON-1942000664 None] Lock "cinder-93bdc03c-87e1-42f8-8113-3e637dff6299-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-daac7acd-03f4-4fef-aa96-dcc1747d49be tempest-VolumesTransfersV357Test-1069822683 None] Acquiring lock "cinder-a09b86a7-9b53-4462-9f12-1513459a5fbf-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-daac7acd-03f4-4fef-aa96-dcc1747d49be tempest-VolumesTransfersV357Test-1069822683 None] Lock "cinder-a09b86a7-9b53-4462-9f12-1513459a5fbf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-daac7acd-03f4-4fef-aa96-dcc1747d49be tempest-VolumesTransfersV357Test-1069822683 None] Acquiring lock "cinder-quobyte-a09b86a7-9b53-4462-9f12-1513459a5fbf" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-daac7acd-03f4-4fef-aa96-dcc1747d49be tempest-VolumesTransfersV357Test-1069822683 None] Lock "cinder-quobyte-a09b86a7-9b53-4462-9f12-1513459a5fbf" acquired by "delete_volume" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:19 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5120abc-5c94-40e7-af60-bd1dc649c01f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-daac7acd-03f4-4fef-aa96-dcc1747d49be tempest-VolumesTransfersV357Test-1069822683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a09b86a7-9b53-4462-9f12-1513459a5fbf {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:19 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a09b86a7-9b53-4462-9f12-1513459a5fbf Nov 02 10:51:19 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:19 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-daac7acd-03f4-4fef-aa96-dcc1747d49be tempest-VolumesTransfersV357Test-1069822683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a09b86a7-9b53-4462-9f12-1513459a5fbf" returned: 0 in 0.490s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-daac7acd-03f4-4fef-aa96-dcc1747d49be tempest-VolumesTransfersV357Test-1069822683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a09b86a7-9b53-4462-9f12-1513459a5fbf {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:20 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a09b86a7-9b53-4462-9f12-1513459a5fbf Nov 02 10:51:20 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:20 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-daac7acd-03f4-4fef-aa96-dcc1747d49be tempest-VolumesTransfersV357Test-1069822683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a09b86a7-9b53-4462-9f12-1513459a5fbf" returned: 0 in 0.293s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-daac7acd-03f4-4fef-aa96-dcc1747d49be tempest-VolumesTransfersV357Test-1069822683 None] Lock "cinder-quobyte-a09b86a7-9b53-4462-9f12-1513459a5fbf" released by "delete_volume" :: held 0.878s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:20 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-daac7acd-03f4-4fef-aa96-dcc1747d49be tempest-VolumesTransfersV357Test-1069822683 None] Created reservations ['4a750a63-1cb1-4e52-b8ef-19900b5810f1', '6902efdc-2fc3-4b1c-a01b-8b5f6e592c55', '042a98ec-fcc1-4b1f-b705-4bb8f5444b1d', '5fc35fe4-89d9-4846-a3c4-ede4cee8a465'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-daac7acd-03f4-4fef-aa96-dcc1747d49be tempest-VolumesTransfersV357Test-1069822683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-daac7acd-03f4-4fef-aa96-dcc1747d49be tempest-VolumesTransfersV357Test-1069822683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-daac7acd-03f4-4fef-aa96-dcc1747d49be tempest-VolumesTransfersV357Test-1069822683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-daac7acd-03f4-4fef-aa96-dcc1747d49be tempest-VolumesTransfersV357Test-1069822683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-daac7acd-03f4-4fef-aa96-dcc1747d49be tempest-VolumesTransfersV357Test-1069822683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-daac7acd-03f4-4fef-aa96-dcc1747d49be tempest-VolumesTransfersV357Test-1069822683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:20 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:51:20 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:20 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-daac7acd-03f4-4fef-aa96-dcc1747d49be tempest-VolumesTransfersV357Test-1069822683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.495s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:20 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-daac7acd-03f4-4fef-aa96-dcc1747d49be tempest-VolumesTransfersV357Test-1069822683 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:51:20 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-daac7acd-03f4-4fef-aa96-dcc1747d49be tempest-VolumesTransfersV357Test-1069822683 None] Deleted volume successfully. Nov 02 10:51:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-daac7acd-03f4-4fef-aa96-dcc1747d49be tempest-VolumesTransfersV357Test-1069822683 None] Lock "cinder-a09b86a7-9b53-4462-9f12-1513459a5fbf-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:27 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=97,cinder:INSERT=30,cinder:UPDATE=111,cinder:DELETE=11 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:51:27 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=92,cinder:UPDATE=135,cinder:INSERT=35,cinder:DELETE=11 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:51:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-c11e6ab2-f77a-453b-a7c4-8edccfd16701 req-d5d63802-4e85-4bf3-811b-c07863b5f253 tempest-TestInstancesWithCinderVolumes-1565881454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-c11e6ab2-f77a-453b-a7c4-8edccfd16701 req-d5d63802-4e85-4bf3-811b-c07863b5f253 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-c11e6ab2-f77a-453b-a7c4-8edccfd16701 req-d5d63802-4e85-4bf3-811b-c07863b5f253 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-c11e6ab2-f77a-453b-a7c4-8edccfd16701 req-d5d63802-4e85-4bf3-811b-c07863b5f253 tempest-TestInstancesWithCinderVolumes-1565881454 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-49cdb182-ec55-46b5-bb80-7f98dbec135a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea897ff2-c077-45e7-935e-66aa07e3e90a', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:51:27 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-c11e6ab2-f77a-453b-a7c4-8edccfd16701 req-d5d63802-4e85-4bf3-811b-c07863b5f253 tempest-TestInstancesWithCinderVolumes-1565881454 None] attachment_update completed successfully. Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Flow 'volume_create_manager' (db3f840b-5841-46a0-a2cd-4f0c89789eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe26be4-6855-4bb8-9924-a65c13046c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe26be4-6855-4bb8-9924-a65c13046c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1315833896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d07f52f2-31d1-414e-9045-444beb85e963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f9665f9f2e94b4b9730d68ff15765f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:28Z,use_quota=True,user_id='1925e338cb154999a0e6b698a5e3eba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46b2d90-ba88-4c87-a5f5-76043aba7d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46b2d90-ba88-4c87-a5f5-76043aba7d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c309f3-5fe4-4494-b58d-79b7bc007354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c309f3-5fe4-4494-b58d-79b7bc007354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd07f52f2-31d1-414e-9045-444beb85e963', 'volume_name': 'volume-d07f52f2-31d1-414e-9045-444beb85e963', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e75a9cfe-26f6-458c-b63a-cf6ec967f821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e75a9cfe-26f6-458c-b63a-cf6ec967f821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f042b7-f782-4b7c-b48d-ac41f05ff070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:28 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Volume d07f52f2-31d1-414e-9045-444beb85e963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d07f52f2-31d1-414e-9045-444beb85e963', 'volume_size': 1} Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1315833896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d07f52f2-31d1-414e-9045-444beb85e963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f9665f9f2e94b4b9730d68ff15765f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:28Z,use_quota=True,user_id='1925e338cb154999a0e6b698a5e3eba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Creating volume d07f52f2-31d1-414e-9045-444beb85e963 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:51:28 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:51:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:28 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963 1073741824 Nov 02 10:51:28 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:29 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963 1073741824" returned: 0 in 0.548s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:29 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963 Nov 02 10:51:29 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:29 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963" returned: 0 in 0.322s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:51:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f042b7-f782-4b7c-b48d-ac41f05ff070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d07f52f2-31d1-414e-9045-444beb85e963', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bfa7140-98f0-418c-af7f-7c8aa7ee993f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:29 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Volume volume-d07f52f2-31d1-414e-9045-444beb85e963 (d07f52f2-31d1-414e-9045-444beb85e963): created successfully Nov 02 10:51:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bfa7140-98f0-418c-af7f-7c8aa7ee993f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Flow 'volume_create_manager' (db3f840b-5841-46a0-a2cd-4f0c89789eea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-484f34dc-c946-4f76-aef2-715676c83aa1 tempest-SnapshotMetadataTestJSON-1399258928 None] Created volume successfully. Nov 02 10:51:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-44361463-f7c6-4790-a547-3dc527981d39 tempest-SnapshotMetadataTestJSON-1399258928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-44361463-f7c6-4790-a547-3dc527981d39 tempest-SnapshotMetadataTestJSON-1399258928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-44361463-f7c6-4790-a547-3dc527981d39 tempest-SnapshotMetadataTestJSON-1399258928 None] Creating offline snapshot c2553bfd-2d07-4655-a1da-3edeff132fde of volume d07f52f2-31d1-414e-9045-444beb85e963 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:51:31 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25220a2-81ef-4b38-9b60-480657abc7f3]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-44361463-f7c6-4790-a547-3dc527981d39 tempest-SnapshotMetadataTestJSON-1399258928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:31 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963 Nov 02 10:51:31 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-d0675959-2bf9-477c-98c5-4f16096d0218 req-4d4f22c0-aeb2-490e-bfc4-d53f75eac958 tempest-TestInstancesWithCinderVolumes-1565881454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:31 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-44361463-f7c6-4790-a547-3dc527981d39 tempest-SnapshotMetadataTestJSON-1399258928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963" returned: 0 in 0.541s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-44361463-f7c6-4790-a547-3dc527981d39 tempest-SnapshotMetadataTestJSON-1399258928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.c2553bfd-2d07-4655-a1da-3edeff132fde 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:31 devstack sudo[99389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.c2553bfd-2d07-4655-a1da-3edeff132fde 1G Nov 02 10:51:31 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:32 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-44361463-f7c6-4790-a547-3dc527981d39 tempest-SnapshotMetadataTestJSON-1399258928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.c2553bfd-2d07-4655-a1da-3edeff132fde 1G" returned: 0 in 0.529s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-44361463-f7c6-4790-a547-3dc527981d39 tempest-SnapshotMetadataTestJSON-1399258928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d07f52f2-31d1-414e-9045-444beb85e963 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.c2553bfd-2d07-4655-a1da-3edeff132fde {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:32 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d07f52f2-31d1-414e-9045-444beb85e963 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.c2553bfd-2d07-4655-a1da-3edeff132fde Nov 02 10:51:32 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:32 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-44361463-f7c6-4790-a547-3dc527981d39 tempest-SnapshotMetadataTestJSON-1399258928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d07f52f2-31d1-414e-9045-444beb85e963 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.c2553bfd-2d07-4655-a1da-3edeff132fde" returned: 0 in 0.413s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:32 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-44361463-f7c6-4790-a547-3dc527981d39 tempest-SnapshotMetadataTestJSON-1399258928 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.c2553bfd-2d07-4655-a1da-3edeff132fde is being set with open permissions: ugo+rw Nov 02 10:51:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-44361463-f7c6-4790-a547-3dc527981d39 tempest-SnapshotMetadataTestJSON-1399258928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.c2553bfd-2d07-4655-a1da-3edeff132fde {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:32 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.c2553bfd-2d07-4655-a1da-3edeff132fde Nov 02 10:51:32 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:32 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-44361463-f7c6-4790-a547-3dc527981d39 tempest-SnapshotMetadataTestJSON-1399258928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.c2553bfd-2d07-4655-a1da-3edeff132fde" returned: 0 in 0.314s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-44361463-f7c6-4790-a547-3dc527981d39 tempest-SnapshotMetadataTestJSON-1399258928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:32 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.info Nov 02 10:51:32 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:33 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-44361463-f7c6-4790-a547-3dc527981d39 tempest-SnapshotMetadataTestJSON-1399258928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.info" returned: 0 in 0.384s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:33 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-44361463-f7c6-4790-a547-3dc527981d39 tempest-SnapshotMetadataTestJSON-1399258928 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.info is being set with open permissions: ugo+rw Nov 02 10:51:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-44361463-f7c6-4790-a547-3dc527981d39 tempest-SnapshotMetadataTestJSON-1399258928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:33 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.info Nov 02 10:51:33 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:33 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-44361463-f7c6-4790-a547-3dc527981d39 tempest-SnapshotMetadataTestJSON-1399258928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.info" returned: 0 in 0.345s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-44361463-f7c6-4790-a547-3dc527981d39 tempest-SnapshotMetadataTestJSON-1399258928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.669s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-d0675959-2bf9-477c-98c5-4f16096d0218 req-4d4f22c0-aeb2-490e-bfc4-d53f75eac958 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.393s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-d0675959-2bf9-477c-98c5-4f16096d0218 req-4d4f22c0-aeb2-490e-bfc4-d53f75eac958 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-44361463-f7c6-4790-a547-3dc527981d39 tempest-SnapshotMetadataTestJSON-1399258928 None] Create snapshot completed successfully Nov 02 10:51:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-d0675959-2bf9-477c-98c5-4f16096d0218 req-4d4f22c0-aeb2-490e-bfc4-d53f75eac958 tempest-TestInstancesWithCinderVolumes-1565881454 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-4f172c1b-7372-4b34-bd79-e2d8b6a1b128', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88f37f9e-d029-4724-80f6-f3ddabddd50a', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:51:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-d0675959-2bf9-477c-98c5-4f16096d0218 req-4d4f22c0-aeb2-490e-bfc4-d53f75eac958 tempest-TestInstancesWithCinderVolumes-1565881454 None] attachment_update completed successfully. Nov 02 10:51:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] Acquiring lock "cinder-c2553bfd-2d07-4655-a1da-3edeff132fde-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] Lock "cinder-c2553bfd-2d07-4655-a1da-3edeff132fde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] Acquiring lock "cinder-quobyte-d07f52f2-31d1-414e-9045-444beb85e963" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] Lock "cinder-quobyte-d07f52f2-31d1-414e-9045-444beb85e963" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] Acquiring lock "cinder-quobyte-c2553bfd-2d07-4655-a1da-3edeff132fde" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] Lock "cinder-quobyte-c2553bfd-2d07-4655-a1da-3edeff132fde" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] Deleting offline snapshot c2553bfd-2d07-4655-a1da-3edeff132fde of volume d07f52f2-31d1-414e-9045-444beb85e963 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:51:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] snapshot_file for this snap is: volume-d07f52f2-31d1-414e-9045-444beb85e963.c2553bfd-2d07-4655-a1da-3edeff132fde {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:51:35 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced8c783-e854-4fe4-8037-207b62246f8b]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.c2553bfd-2d07-4655-a1da-3edeff132fde {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:35 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.c2553bfd-2d07-4655-a1da-3edeff132fde Nov 02 10:51:35 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:36 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.c2553bfd-2d07-4655-a1da-3edeff132fde" returned: 0 in 0.462s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d07f52f2-31d1-414e-9045-444beb85e963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:51:36 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61780ce-6e9c-44aa-8f8a-3ceaa7fedf05]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:36 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963 Nov 02 10:51:36 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:36 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963" returned: 0 in 0.698s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.c2553bfd-2d07-4655-a1da-3edeff132fde {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:36 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.c2553bfd-2d07-4655-a1da-3edeff132fde Nov 02 10:51:36 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:37 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.c2553bfd-2d07-4655-a1da-3edeff132fde" returned: 0 in 0.561s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.c2553bfd-2d07-4655-a1da-3edeff132fde {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:37 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.c2553bfd-2d07-4655-a1da-3edeff132fde Nov 02 10:51:37 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:37 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963.c2553bfd-2d07-4655-a1da-3edeff132fde" returned: 0 in 0.364s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] Lock "cinder-quobyte-c2553bfd-2d07-4655-a1da-3edeff132fde" released by "_delete_snapshot" :: held 2.264s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] Lock "cinder-quobyte-d07f52f2-31d1-414e-9045-444beb85e963" released by "delete_snapshot" :: held 2.289s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:38 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] Created reservations ['48bee93c-ce10-4de8-a603-e2b9bbb4bb80', '6eb6b938-223a-4a63-95ec-c17c7ff08f98', 'b8e820a9-defe-46a4-8333-9bcaeb458c6f', 'f823ffa3-8393-4998-9dc0-554b03fa412b'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:38 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] Delete snapshot completed successfully. Nov 02 10:51:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c2aeb496-538b-4a3b-bae1-7460de15b13b tempest-SnapshotMetadataTestJSON-1399258928 None] Lock "cinder-c2553bfd-2d07-4655-a1da-3edeff132fde-delete_snapshot" released by "delete_snapshot" :: held 2.512s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-43587b9e-7d2b-4955-80b0-8713f207873f tempest-SnapshotMetadataTestJSON-1399258928 None] Acquiring lock "cinder-d07f52f2-31d1-414e-9045-444beb85e963-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-43587b9e-7d2b-4955-80b0-8713f207873f tempest-SnapshotMetadataTestJSON-1399258928 None] Lock "cinder-d07f52f2-31d1-414e-9045-444beb85e963-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-43587b9e-7d2b-4955-80b0-8713f207873f tempest-SnapshotMetadataTestJSON-1399258928 None] Acquiring lock "cinder-quobyte-d07f52f2-31d1-414e-9045-444beb85e963" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-43587b9e-7d2b-4955-80b0-8713f207873f tempest-SnapshotMetadataTestJSON-1399258928 None] Lock "cinder-quobyte-d07f52f2-31d1-414e-9045-444beb85e963" acquired by "delete_volume" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:39 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5345d647-31bb-4d7f-815e-2c6e25050db5]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43587b9e-7d2b-4955-80b0-8713f207873f tempest-SnapshotMetadataTestJSON-1399258928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:39 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963 Nov 02 10:51:39 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:39 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43587b9e-7d2b-4955-80b0-8713f207873f tempest-SnapshotMetadataTestJSON-1399258928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963" returned: 0 in 0.491s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43587b9e-7d2b-4955-80b0-8713f207873f tempest-SnapshotMetadataTestJSON-1399258928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:39 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963 Nov 02 10:51:39 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:40 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43587b9e-7d2b-4955-80b0-8713f207873f tempest-SnapshotMetadataTestJSON-1399258928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d07f52f2-31d1-414e-9045-444beb85e963" returned: 0 in 0.330s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-43587b9e-7d2b-4955-80b0-8713f207873f tempest-SnapshotMetadataTestJSON-1399258928 None] Lock "cinder-quobyte-d07f52f2-31d1-414e-9045-444beb85e963" released by "delete_volume" :: held 0.936s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:40 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-43587b9e-7d2b-4955-80b0-8713f207873f tempest-SnapshotMetadataTestJSON-1399258928 None] Created reservations ['786a208c-1d08-4929-8773-597b5d98a490', '32cb1c83-6b38-4237-9010-03f271df9550', 'c19f7602-3901-400d-b8a5-021ad31907b0', 'ea32d3a4-f7cc-4c44-8799-8ac48bbacf4e'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-43587b9e-7d2b-4955-80b0-8713f207873f tempest-SnapshotMetadataTestJSON-1399258928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-43587b9e-7d2b-4955-80b0-8713f207873f tempest-SnapshotMetadataTestJSON-1399258928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-43587b9e-7d2b-4955-80b0-8713f207873f tempest-SnapshotMetadataTestJSON-1399258928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-43587b9e-7d2b-4955-80b0-8713f207873f tempest-SnapshotMetadataTestJSON-1399258928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-43587b9e-7d2b-4955-80b0-8713f207873f tempest-SnapshotMetadataTestJSON-1399258928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43587b9e-7d2b-4955-80b0-8713f207873f tempest-SnapshotMetadataTestJSON-1399258928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:40 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:51:40 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:40 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43587b9e-7d2b-4955-80b0-8713f207873f tempest-SnapshotMetadataTestJSON-1399258928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.364s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:40 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-43587b9e-7d2b-4955-80b0-8713f207873f tempest-SnapshotMetadataTestJSON-1399258928 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:51:40 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-43587b9e-7d2b-4955-80b0-8713f207873f tempest-SnapshotMetadataTestJSON-1399258928 None] Deleted volume successfully. Nov 02 10:51:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-43587b9e-7d2b-4955-80b0-8713f207873f tempest-SnapshotMetadataTestJSON-1399258928 None] Lock "cinder-d07f52f2-31d1-414e-9045-444beb85e963-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:40 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-b04d0a74-ec61-4699-a0f6-ef53aa1c2d89 req-fdcc30a7-7feb-4066-891e-8824cc050d45 tempest-TestInstancesWithCinderVolumes-1565881454 None] Terminate volume connection completed successfully. Nov 02 10:51:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-b04d0a74-ec61-4699-a0f6-ef53aa1c2d89 req-fdcc30a7-7feb-4066-891e-8824cc050d45 tempest-TestInstancesWithCinderVolumes-1565881454 None] Deleting attachment ea897ff2-c077-45e7-935e-66aa07e3e90a. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:51:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] Acquiring lock "cinder-49cdb182-ec55-46b5-bb80-7f98dbec135a-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "cinder-49cdb182-ec55-46b5-bb80-7f98dbec135a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] Acquiring lock "cinder-quobyte-49cdb182-ec55-46b5-bb80-7f98dbec135a" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "cinder-quobyte-49cdb182-ec55-46b5-bb80-7f98dbec135a" acquired by "delete_volume" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:41 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f297044-fe5b-44c0-8d80-28305fa7dcde]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-49cdb182-ec55-46b5-bb80-7f98dbec135a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:41 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-49cdb182-ec55-46b5-bb80-7f98dbec135a Nov 02 10:51:41 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:42 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-49cdb182-ec55-46b5-bb80-7f98dbec135a" returned: 0 in 0.836s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-49cdb182-ec55-46b5-bb80-7f98dbec135a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:42 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-49cdb182-ec55-46b5-bb80-7f98dbec135a Nov 02 10:51:42 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:42 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-49cdb182-ec55-46b5-bb80-7f98dbec135a" returned: 0 in 0.478s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "cinder-quobyte-49cdb182-ec55-46b5-bb80-7f98dbec135a" released by "delete_volume" :: held 1.390s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:42 devstack cinder-volume[87084]: WARNING cinder.quota [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-706388869-1171597508 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-706388869-1171597508, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:51:42 devstack cinder-volume[87084]: WARNING cinder.quota [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-706388869-1171597508 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-706388869-1171597508, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:51:43 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] Created reservations ['2b0d9602-0878-4a82-bc20-a554cb44ad10', '220b0557-cc29-426e-8100-773c6e56d8d2', '1a420cdf-d8c6-43ad-9794-b689bb197234', '9c22d15c-ec7e-4bfc-9247-2da613e1aee9'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:43 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:51:43 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:43 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.513s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:43 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:51:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] Deleted volume successfully. Nov 02 10:51:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ec4e6b5f-7781-4d0b-829f-baeee75480a0 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "cinder-49cdb182-ec55-46b5-bb80-7f98dbec135a-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:46 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-1a450c6e-7d53-4a8b-96e8-4d7cbd2dbdf5 req-de160abe-f7fe-401a-9463-56b472b74a2e tempest-TestInstancesWithCinderVolumes-1565881454 None] Terminate volume connection completed successfully. Nov 02 10:51:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-1a450c6e-7d53-4a8b-96e8-4d7cbd2dbdf5 req-de160abe-f7fe-401a-9463-56b472b74a2e tempest-TestInstancesWithCinderVolumes-1565881454 None] Deleting attachment 88f37f9e-d029-4724-80f6-f3ddabddd50a. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:51:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] Acquiring lock "cinder-4f172c1b-7372-4b34-bd79-e2d8b6a1b128-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "cinder-4f172c1b-7372-4b34-bd79-e2d8b6a1b128-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] Acquiring lock "cinder-quobyte-4f172c1b-7372-4b34-bd79-e2d8b6a1b128" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "cinder-quobyte-4f172c1b-7372-4b34-bd79-e2d8b6a1b128" acquired by "delete_volume" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:47 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb0788e-22a4-4914-800d-7fdfeb431502]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f172c1b-7372-4b34-bd79-e2d8b6a1b128 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:47 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f172c1b-7372-4b34-bd79-e2d8b6a1b128 Nov 02 10:51:47 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:48 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f172c1b-7372-4b34-bd79-e2d8b6a1b128" returned: 0 in 0.629s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f172c1b-7372-4b34-bd79-e2d8b6a1b128 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:48 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f172c1b-7372-4b34-bd79-e2d8b6a1b128 Nov 02 10:51:48 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:48 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4f172c1b-7372-4b34-bd79-e2d8b6a1b128" returned: 0 in 0.314s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "cinder-quobyte-4f172c1b-7372-4b34-bd79-e2d8b6a1b128" released by "delete_volume" :: held 1.027s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:48 devstack cinder-volume[87084]: WARNING cinder.quota [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-724912041-822285537 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-724912041-822285537, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:51:48 devstack cinder-volume[87084]: WARNING cinder.quota [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-724912041-822285537 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-724912041-822285537, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:51:48 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] Created reservations ['d2d93c68-fdee-481c-b070-5aea785bcc80', 'f9f7eca8-b7e5-44a9-82cd-5566cac24d57', 'b8ebf8df-1dad-48c5-b017-974b9f75845a', '61799138-bb55-4e17-a92c-a6da0d9822f9'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:48 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:51:49 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:49 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.423s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:51:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] Deleted volume successfully. Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-34d204bd-19ec-415a-ac58-aaba1c87550c tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "cinder-4f172c1b-7372-4b34-bd79-e2d8b6a1b128-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Flow 'volume_create_manager' (4e294ec9-b98a-4ac8-b124-a6d9dd78c879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4826207f-c6e7-4c94-a749-7b36a4e37e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4826207f-c6e7-4c94-a749-7b36a4e37e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-772408114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a0994f-8d07-479e-862b-48deeeb1def0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a017b8506c44b29bc53ebf0b2f90e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:49Z,use_quota=True,user_id='350b859dd2504393b5b77ed3de20ea2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74e46261-9a44-452b-aac4-1ef0fa3c5645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74e46261-9a44-452b-aac4-1ef0fa3c5645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea6f80b7-b034-427b-9f02-b386f21d5b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea6f80b7-b034-427b-9f02-b386f21d5b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8a0994f-8d07-479e-862b-48deeeb1def0', 'volume_name': 'volume-d8a0994f-8d07-479e-862b-48deeeb1def0', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c2f8c9-59dc-424b-ae9e-e7b9e0adb820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c2f8c9-59dc-424b-ae9e-e7b9e0adb820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da336ea-f22b-4d42-bf64-a402817c8517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:49 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Volume d8a0994f-8d07-479e-862b-48deeeb1def0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8a0994f-8d07-479e-862b-48deeeb1def0', 'volume_size': 1} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-772408114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a0994f-8d07-479e-862b-48deeeb1def0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a017b8506c44b29bc53ebf0b2f90e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:49Z,use_quota=True,user_id='350b859dd2504393b5b77ed3de20ea2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Creating volume d8a0994f-8d07-479e-862b-48deeeb1def0 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:51:49 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:51:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d8a0994f-8d07-479e-862b-48deeeb1def0 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:49 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d8a0994f-8d07-479e-862b-48deeeb1def0 1073741824 Nov 02 10:51:49 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:50 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d8a0994f-8d07-479e-862b-48deeeb1def0 1073741824" returned: 0 in 0.587s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d8a0994f-8d07-479e-862b-48deeeb1def0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:50 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d8a0994f-8d07-479e-862b-48deeeb1def0 Nov 02 10:51:50 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:50 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d8a0994f-8d07-479e-862b-48deeeb1def0" returned: 0 in 0.380s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:51:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da336ea-f22b-4d42-bf64-a402817c8517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8a0994f-8d07-479e-862b-48deeeb1def0', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9073a68c-8347-4fb8-8532-9191e96cd441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:50 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Volume volume-d8a0994f-8d07-479e-862b-48deeeb1def0 (d8a0994f-8d07-479e-862b-48deeeb1def0): created successfully Nov 02 10:51:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9073a68c-8347-4fb8-8532-9191e96cd441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Flow 'volume_create_manager' (4e294ec9-b98a-4ac8-b124-a6d9dd78c879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:50 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4206d49b-d250-4963-8dcc-2ed8c8beb6fc tempest-AbsoluteLimitsTests-1550187811 None] Created volume successfully. Nov 02 10:51:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-258af96f-8e0e-48fc-9b76-b04eaf71fd78 tempest-AbsoluteLimitsTests-1550187811 None] Acquiring lock "cinder-d8a0994f-8d07-479e-862b-48deeeb1def0-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-258af96f-8e0e-48fc-9b76-b04eaf71fd78 tempest-AbsoluteLimitsTests-1550187811 None] Lock "cinder-d8a0994f-8d07-479e-862b-48deeeb1def0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-258af96f-8e0e-48fc-9b76-b04eaf71fd78 tempest-AbsoluteLimitsTests-1550187811 None] Acquiring lock "cinder-quobyte-d8a0994f-8d07-479e-862b-48deeeb1def0" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-258af96f-8e0e-48fc-9b76-b04eaf71fd78 tempest-AbsoluteLimitsTests-1550187811 None] Lock "cinder-quobyte-d8a0994f-8d07-479e-862b-48deeeb1def0" acquired by "delete_volume" :: waited 0.051s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:52 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb20a317-0813-4484-a94a-ae3aa0081706]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-258af96f-8e0e-48fc-9b76-b04eaf71fd78 tempest-AbsoluteLimitsTests-1550187811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d8a0994f-8d07-479e-862b-48deeeb1def0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:51:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:53 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:51:53 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:53 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d8a0994f-8d07-479e-862b-48deeeb1def0 Nov 02 10:51:53 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:53 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.324s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:51:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:51:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:51:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:51:53 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-258af96f-8e0e-48fc-9b76-b04eaf71fd78 tempest-AbsoluteLimitsTests-1550187811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d8a0994f-8d07-479e-862b-48deeeb1def0" returned: 0 in 0.721s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-258af96f-8e0e-48fc-9b76-b04eaf71fd78 tempest-AbsoluteLimitsTests-1550187811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d8a0994f-8d07-479e-862b-48deeeb1def0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:53 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d8a0994f-8d07-479e-862b-48deeeb1def0 Nov 02 10:51:53 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:54 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-258af96f-8e0e-48fc-9b76-b04eaf71fd78 tempest-AbsoluteLimitsTests-1550187811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d8a0994f-8d07-479e-862b-48deeeb1def0" returned: 0 in 0.662s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-258af96f-8e0e-48fc-9b76-b04eaf71fd78 tempest-AbsoluteLimitsTests-1550187811 None] Lock "cinder-quobyte-d8a0994f-8d07-479e-862b-48deeeb1def0" released by "delete_volume" :: held 1.512s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:54 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-258af96f-8e0e-48fc-9b76-b04eaf71fd78 tempest-AbsoluteLimitsTests-1550187811 None] Created reservations ['a5c23fa2-9c33-4bc3-8ffa-b508384b922f', '798e01ac-4521-423e-8c0e-d5db7c1169ee', 'c3948ec2-f110-4fb6-835d-e0d1c95707fd', 'a6281e8d-de72-47b0-a73a-402522fd93af'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-258af96f-8e0e-48fc-9b76-b04eaf71fd78 tempest-AbsoluteLimitsTests-1550187811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-258af96f-8e0e-48fc-9b76-b04eaf71fd78 tempest-AbsoluteLimitsTests-1550187811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-258af96f-8e0e-48fc-9b76-b04eaf71fd78 tempest-AbsoluteLimitsTests-1550187811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-258af96f-8e0e-48fc-9b76-b04eaf71fd78 tempest-AbsoluteLimitsTests-1550187811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-258af96f-8e0e-48fc-9b76-b04eaf71fd78 tempest-AbsoluteLimitsTests-1550187811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-258af96f-8e0e-48fc-9b76-b04eaf71fd78 tempest-AbsoluteLimitsTests-1550187811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:54 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:51:54 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:55 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-258af96f-8e0e-48fc-9b76-b04eaf71fd78 tempest-AbsoluteLimitsTests-1550187811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.574s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:55 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-258af96f-8e0e-48fc-9b76-b04eaf71fd78 tempest-AbsoluteLimitsTests-1550187811 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:51:55 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-258af96f-8e0e-48fc-9b76-b04eaf71fd78 tempest-AbsoluteLimitsTests-1550187811 None] Deleted volume successfully. Nov 02 10:51:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-258af96f-8e0e-48fc-9b76-b04eaf71fd78 tempest-AbsoluteLimitsTests-1550187811 None] Lock "cinder-d8a0994f-8d07-479e-862b-48deeeb1def0-delete_volume" released by "delete_volume" :: held 2.795s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-f609ead2-336a-4635-a32a-90b2431aa05e req-1f896d1a-1b62-4860-8909-45a298e79164 tempest-TestInstancesWithCinderVolumes-1565881454 None] Terminate volume connection completed successfully. Nov 02 10:51:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-f609ead2-336a-4635-a32a-90b2431aa05e req-1f896d1a-1b62-4860-8909-45a298e79164 tempest-TestInstancesWithCinderVolumes-1565881454 None] Deleting attachment 11aed8cf-abbc-4e0c-89e3-cca0b9d11a51. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:52:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] Acquiring lock "cinder-02b31773-5008-4a02-8edc-9f1487846061-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "cinder-02b31773-5008-4a02-8edc-9f1487846061-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] Acquiring lock "cinder-quobyte-02b31773-5008-4a02-8edc-9f1487846061" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "cinder-quobyte-02b31773-5008-4a02-8edc-9f1487846061" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:00 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f890bbc5-c310-468e-8fd4-54da2eb31cc8]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-02b31773-5008-4a02-8edc-9f1487846061 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:00 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-02b31773-5008-4a02-8edc-9f1487846061 Nov 02 10:52:00 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:01 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-02b31773-5008-4a02-8edc-9f1487846061" returned: 0 in 0.607s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-02b31773-5008-4a02-8edc-9f1487846061 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:01 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-02b31773-5008-4a02-8edc-9f1487846061 Nov 02 10:52:01 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:01 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-02b31773-5008-4a02-8edc-9f1487846061" returned: 0 in 0.435s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "cinder-quobyte-02b31773-5008-4a02-8edc-9f1487846061" released by "delete_volume" :: held 1.113s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:01 devstack cinder-volume[87084]: WARNING cinder.quota [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1379276632-1609368158 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1379276632-1609368158, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:52:01 devstack cinder-volume[87084]: WARNING cinder.quota [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1379276632-1609368158 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1379276632-1609368158, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:52:01 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] Created reservations ['d99a3edc-8902-402b-8b5b-2ec880901c48', 'a925a19d-b3d3-4e82-a1fb-5c3aa2de216b', 'bcab532f-3aef-4f2c-a429-aa2b37bd9964', 'b754771a-1a70-45c1-ba76-ab5372e5cf36'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:01 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:52:01 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:02 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.394s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:02 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:02 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] Deleted volume successfully. Nov 02 10:52:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ebd2858b-d19b-446b-b225-5672dc1e2721 tempest-TestInstancesWithCinderVolumes-1565881454 None] Lock "cinder-02b31773-5008-4a02-8edc-9f1487846061-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Flow 'volume_create_manager' (09ba5f08-fbbd-4ec3-af96-207a00e6e5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abefcded-8bc6-4680-a1ff-9946d49daae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abefcded-8bc6-4680-a1ff-9946d49daae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1954932474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e037f5-3fd1-4471-804b-80db371f9d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e35c14de514aabb687a5175d2efb24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:07Z,use_quota=True,user_id='7605dcd94b604d338dfc0962278952bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02952bc7-bf23-4915-9172-f7e2f86c63b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02952bc7-bf23-4915-9172-f7e2f86c63b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da505e6a-d0cb-4ee3-97fd-9535ef2a2f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da505e6a-d0cb-4ee3-97fd-9535ef2a2f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16e037f5-3fd1-4471-804b-80db371f9d76', 'volume_name': 'volume-16e037f5-3fd1-4471-804b-80db371f9d76', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b484f4a1-c92d-45c1-83cf-109a473c1dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b484f4a1-c92d-45c1-83cf-109a473c1dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50764012-93a7-44ed-924e-8e087b77165c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:07 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Volume 16e037f5-3fd1-4471-804b-80db371f9d76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16e037f5-3fd1-4471-804b-80db371f9d76', 'volume_size': 1} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1954932474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e037f5-3fd1-4471-804b-80db371f9d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e35c14de514aabb687a5175d2efb24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:07Z,use_quota=True,user_id='7605dcd94b604d338dfc0962278952bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Creating volume 16e037f5-3fd1-4471-804b-80db371f9d76 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:07 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:07 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76 1073741824 Nov 02 10:52:07 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:07 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76 1073741824" returned: 0 in 0.566s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:07 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76 Nov 02 10:52:07 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:08 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76" returned: 0 in 0.282s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:52:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50764012-93a7-44ed-924e-8e087b77165c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16e037f5-3fd1-4471-804b-80db371f9d76', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdf1cc8-bb4c-48c8-8593-1408af8677cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:08 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Volume volume-16e037f5-3fd1-4471-804b-80db371f9d76 (16e037f5-3fd1-4471-804b-80db371f9d76): created successfully Nov 02 10:52:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdf1cc8-bb4c-48c8-8593-1408af8677cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Flow 'volume_create_manager' (09ba5f08-fbbd-4ec3-af96-207a00e6e5b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:08 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-988b0bc3-c8c8-49c7-93f5-6db64df54acb tempest-VolumesDeleteCascade-1648389586 None] Created volume successfully. Nov 02 10:52:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-00174d11-bc9f-41f5-a2e6-8a73a3e125e9 tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-00174d11-bc9f-41f5-a2e6-8a73a3e125e9 tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-00174d11-bc9f-41f5-a2e6-8a73a3e125e9 tempest-VolumesDeleteCascade-1648389586 None] Creating offline snapshot ffd78614-155d-4812-9013-76d0f90cb3e2 of volume 16e037f5-3fd1-4471-804b-80db371f9d76 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:52:09 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[019feca4-a8ee-421b-ab2b-cadc7281b206]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-00174d11-bc9f-41f5-a2e6-8a73a3e125e9 tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:09 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76 Nov 02 10:52:09 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:10 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-00174d11-bc9f-41f5-a2e6-8a73a3e125e9 tempest-VolumesDeleteCascade-1648389586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76" returned: 0 in 0.403s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-00174d11-bc9f-41f5-a2e6-8a73a3e125e9 tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:10 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:10 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 1G Nov 02 10:52:10 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Flow 'volume_create_manager' (b699a431-2543-4903-b34c-83d9943b2918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287ece79-b47d-4132-9ba6-a8189d8f5103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287ece79-b47d-4132-9ba6-a8189d8f5103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-377561399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f25abfd-73d6-46f7-a55f-0f25861b5a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b3e72ab6af4a60a7a62f8e4ee0dce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:10Z,use_quota=True,user_id='563ede5609484577a56a88f0e161ee3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ad4741-4f60-46df-bd05-0ceefea392aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ad4741-4f60-46df-bd05-0ceefea392aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce6920d-81de-4ea6-bde5-3733602774cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce6920d-81de-4ea6-bde5-3733602774cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f25abfd-73d6-46f7-a55f-0f25861b5a0c', 'volume_name': 'volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc3399b-7623-488f-a166-5992e2a3cde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc3399b-7623-488f-a166-5992e2a3cde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a2f76b-ee7b-4c10-9fa7-bc58ce9734fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:10 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Volume 9f25abfd-73d6-46f7-a55f-0f25861b5a0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c', 'volume_size': 1} Nov 02 10:52:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:10 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-00174d11-bc9f-41f5-a2e6-8a73a3e125e9 tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 1G" returned: 0 in 0.501s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-00174d11-bc9f-41f5-a2e6-8a73a3e125e9 tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16e037f5-3fd1-4471-804b-80db371f9d76 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:10 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16e037f5-3fd1-4471-804b-80db371f9d76 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 Nov 02 10:52:10 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:10 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-00174d11-bc9f-41f5-a2e6-8a73a3e125e9 tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16e037f5-3fd1-4471-804b-80db371f9d76 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2" returned: 0 in 0.329s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:10 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-00174d11-bc9f-41f5-a2e6-8a73a3e125e9 tempest-VolumesDeleteCascade-1648389586 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 is being set with open permissions: ugo+rw Nov 02 10:52:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-00174d11-bc9f-41f5-a2e6-8a73a3e125e9 tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:10 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 Nov 02 10:52:10 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:11 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-00174d11-bc9f-41f5-a2e6-8a73a3e125e9 tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2" returned: 0 in 0.275s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-00174d11-bc9f-41f5-a2e6-8a73a3e125e9 tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:11 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.info Nov 02 10:52:11 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:11 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-00174d11-bc9f-41f5-a2e6-8a73a3e125e9 tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.info" returned: 0 in 0.253s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:11 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-00174d11-bc9f-41f5-a2e6-8a73a3e125e9 tempest-VolumesDeleteCascade-1648389586 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.info is being set with open permissions: ugo+rw Nov 02 10:52:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-00174d11-bc9f-41f5-a2e6-8a73a3e125e9 tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:11 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.info Nov 02 10:52:11 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:11 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-00174d11-bc9f-41f5-a2e6-8a73a3e125e9 tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.info" returned: 0 in 0.245s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-00174d11-bc9f-41f5-a2e6-8a73a3e125e9 tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.116s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.573s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-377561399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f25abfd-73d6-46f7-a55f-0f25861b5a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b3e72ab6af4a60a7a62f8e4ee0dce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:10Z,use_quota=True,user_id='563ede5609484577a56a88f0e161ee3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:52:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Creating volume 9f25abfd-73d6-46f7-a55f-0f25861b5a0c {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:11 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:52:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:11 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c 1073741824 Nov 02 10:52:11 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:11 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-00174d11-bc9f-41f5-a2e6-8a73a3e125e9 tempest-VolumesDeleteCascade-1648389586 None] Create snapshot completed successfully Nov 02 10:52:12 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c 1073741824" returned: 0 in 0.496s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:12 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c Nov 02 10:52:12 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:12 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c" returned: 0 in 0.313s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:52:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a2f76b-ee7b-4c10-9fa7-bc58ce9734fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b535b96b-61b3-4d3c-911a-98456a53f0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:12 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Volume volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c (9f25abfd-73d6-46f7-a55f-0f25861b5a0c): created successfully Nov 02 10:52:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b535b96b-61b3-4d3c-911a-98456a53f0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Flow 'volume_create_manager' (b699a431-2543-4903-b34c-83d9943b2918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:12 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-224406f3-e195-40a3-8750-83a5d16dbd24 tempest-TestImageHashVerification-1517896129 None] Created volume successfully. Nov 02 10:52:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6977779d-e75a-4257-aafa-5adb6b27eec3 tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6977779d-e75a-4257-aafa-5adb6b27eec3 tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6977779d-e75a-4257-aafa-5adb6b27eec3 tempest-VolumesDeleteCascade-1648389586 None] Creating offline snapshot 4619e99e-619b-4e19-9bc4-58440906dc28 of volume 16e037f5-3fd1-4471-804b-80db371f9d76 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:52:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdeb40a-9aae-4855-b820-7cc6f7746942]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6977779d-e75a-4257-aafa-5adb6b27eec3 tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:13 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 Nov 02 10:52:13 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:13 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6977779d-e75a-4257-aafa-5adb6b27eec3 tempest-VolumesDeleteCascade-1648389586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2" returned: 0 in 0.628s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6977779d-e75a-4257-aafa-5adb6b27eec3 tempest-VolumesDeleteCascade-1648389586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16e037f5-3fd1-4471-804b-80db371f9d76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:52:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6977779d-e75a-4257-aafa-5adb6b27eec3 tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.4619e99e-619b-4e19-9bc4-58440906dc28 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:13 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.4619e99e-619b-4e19-9bc4-58440906dc28 1G Nov 02 10:52:13 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:14 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6977779d-e75a-4257-aafa-5adb6b27eec3 tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.4619e99e-619b-4e19-9bc4-58440906dc28 1G" returned: 0 in 0.595s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6977779d-e75a-4257-aafa-5adb6b27eec3 tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.4619e99e-619b-4e19-9bc4-58440906dc28 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:14 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.4619e99e-619b-4e19-9bc4-58440906dc28 Nov 02 10:52:14 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4a313394-cf10-4c49-afa2-e5f56e5dc2c9 tempest-TestImageHashVerification-1517896129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:14 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6977779d-e75a-4257-aafa-5adb6b27eec3 tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.4619e99e-619b-4e19-9bc4-58440906dc28" returned: 0 in 0.371s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:14 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-6977779d-e75a-4257-aafa-5adb6b27eec3 tempest-VolumesDeleteCascade-1648389586 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.4619e99e-619b-4e19-9bc4-58440906dc28 is being set with open permissions: ugo+rw Nov 02 10:52:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6977779d-e75a-4257-aafa-5adb6b27eec3 tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.4619e99e-619b-4e19-9bc4-58440906dc28 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:14 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.4619e99e-619b-4e19-9bc4-58440906dc28 Nov 02 10:52:14 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:15 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6977779d-e75a-4257-aafa-5adb6b27eec3 tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.4619e99e-619b-4e19-9bc4-58440906dc28" returned: 0 in 0.303s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6977779d-e75a-4257-aafa-5adb6b27eec3 tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.058s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4a313394-cf10-4c49-afa2-e5f56e5dc2c9 tempest-TestImageHashVerification-1517896129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.601s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:15 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e92c4b-405c-4667-a1be-b19f80be4624]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a313394-cf10-4c49-afa2-e5f56e5dc2c9 tempest-TestImageHashVerification-1517896129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:15 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6977779d-e75a-4257-aafa-5adb6b27eec3 tempest-VolumesDeleteCascade-1648389586 None] Create snapshot completed successfully Nov 02 10:52:15 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c Nov 02 10:52:15 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:15 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a313394-cf10-4c49-afa2-e5f56e5dc2c9 tempest-TestImageHashVerification-1517896129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c" returned: 0 in 0.377s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:15 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[24209998-6237-4c33-8a30-8b6b5c9e2328]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a313394-cf10-4c49-afa2-e5f56e5dc2c9 tempest-TestImageHashVerification-1517896129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:15 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c Nov 02 10:52:15 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:16 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a313394-cf10-4c49-afa2-e5f56e5dc2c9 tempest-TestImageHashVerification-1517896129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c" returned: 0 in 0.423s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a313394-cf10-4c49-afa2-e5f56e5dc2c9 tempest-TestImageHashVerification-1517896129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c /opt/stack/data/cinder/conversion/9f25abfd-73d6-46f7-a55f-0f25861b5a0c.temp_image.5ab5fd39-67ec-483a-958d-c57e6d4cd1214toc0be7.img {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:16 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c /opt/stack/data/cinder/conversion/9f25abfd-73d6-46f7-a55f-0f25861b5a0c.temp_image.5ab5fd39-67ec-483a-958d-c57e6d4cd1214toc0be7.img Nov 02 10:52:16 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "cinder-16e037f5-3fd1-4471-804b-80db371f9d76-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-16e037f5-3fd1-4471-804b-80db371f9d76-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Performing cascade delete. {{(pid=87084) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 10:52:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "cinder-4619e99e-619b-4e19-9bc4-58440906dc28-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-4619e99e-619b-4e19-9bc4-58440906dc28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "cinder-quobyte-16e037f5-3fd1-4471-804b-80db371f9d76" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-16e037f5-3fd1-4471-804b-80db371f9d76" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "cinder-quobyte-4619e99e-619b-4e19-9bc4-58440906dc28" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-4619e99e-619b-4e19-9bc4-58440906dc28" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Deleting offline snapshot 4619e99e-619b-4e19-9bc4-58440906dc28 of volume 16e037f5-3fd1-4471-804b-80db371f9d76 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:52:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] snapshot_file for this snap is: volume-16e037f5-3fd1-4471-804b-80db371f9d76.4619e99e-619b-4e19-9bc4-58440906dc28 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:52:17 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[63314243-eb6c-495e-b792-50b32029df4c]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.4619e99e-619b-4e19-9bc4-58440906dc28 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:17 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.4619e99e-619b-4e19-9bc4-58440906dc28 Nov 02 10:52:17 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:18 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.4619e99e-619b-4e19-9bc4-58440906dc28" returned: 0 in 1.198s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16e037f5-3fd1-4471-804b-80db371f9d76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:52:18 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d657884d-53bd-4a9f-9da5-c5b70f4eec42]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:18 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 Nov 02 10:52:18 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:19 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Flow 'volume_create_manager' (db67a8d7-45f9-4848-aee5-0ccf1eca5353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b29196-a08c-4b8a-ae6b-8514f0d50466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b29196-a08c-4b8a-ae6b-8514f0d50466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1507482648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a0c9db-03e1-4de4-b393-62486a313c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a71ef6e33442ccb46d485f73c896b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:19Z,use_quota=True,user_id='3ceea3b68ef4430b8b98cd2abf145653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22157a9-5771-45bf-ae4c-394805ee92d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22157a9-5771-45bf-ae4c-394805ee92d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e84dafba-fccd-4c65-b213-17cfe047daf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e84dafba-fccd-4c65-b213-17cfe047daf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a0c9db-03e1-4de4-b393-62486a313c5a', 'volume_name': 'volume-84a0c9db-03e1-4de4-b393-62486a313c5a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0795ca70-8c46-468f-ac99-8b8ebbd8a14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0795ca70-8c46-468f-ac99-8b8ebbd8a14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0dd6ad-7fde-43e5-8e72-c945a3b0f3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:19 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Volume 84a0c9db-03e1-4de4-b393-62486a313c5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a0c9db-03e1-4de4-b393-62486a313c5a', 'volume_size': 1} Nov 02 10:52:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:19 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2" returned: 0 in 1.270s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16e037f5-3fd1-4471-804b-80db371f9d76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:52:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.4619e99e-619b-4e19-9bc4-58440906dc28 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:19 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.4619e99e-619b-4e19-9bc4-58440906dc28 Nov 02 10:52:19 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:20 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.4619e99e-619b-4e19-9bc4-58440906dc28" returned: 0 in 1.101s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.4619e99e-619b-4e19-9bc4-58440906dc28 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:20 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.4619e99e-619b-4e19-9bc4-58440906dc28 Nov 02 10:52:20 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:21 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.4619e99e-619b-4e19-9bc4-58440906dc28" returned: 0 in 0.613s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-4619e99e-619b-4e19-9bc4-58440906dc28" released by "_delete_snapshot" :: held 4.480s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-16e037f5-3fd1-4471-804b-80db371f9d76" released by "delete_snapshot" :: held 4.551s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:21 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Created reservations ['a452e08e-f2db-4653-a9d1-75f9469d6987', '2e7fe7d1-ed18-465f-b3b1-e34374da84d2', '773b1489-7eba-4983-ad2d-aebd59bf3189', '9b60ca4b-84b6-4891-b87b-0cff66652598'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:21 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Delete snapshot completed successfully. Nov 02 10:52:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-4619e99e-619b-4e19-9bc4-58440906dc28-delete_snapshot" released by "delete_snapshot" :: held 4.955s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "cinder-ffd78614-155d-4812-9013-76d0f90cb3e2-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-ffd78614-155d-4812-9013-76d0f90cb3e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "cinder-quobyte-16e037f5-3fd1-4471-804b-80db371f9d76" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-16e037f5-3fd1-4471-804b-80db371f9d76" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "cinder-quobyte-ffd78614-155d-4812-9013-76d0f90cb3e2" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-ffd78614-155d-4812-9013-76d0f90cb3e2" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Deleting offline snapshot ffd78614-155d-4812-9013-76d0f90cb3e2 of volume 16e037f5-3fd1-4471-804b-80db371f9d76 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:52:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] snapshot_file for this snap is: volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:52:21 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc99518-7418-4af9-afb5-4633af8d81f3]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:22 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 Nov 02 10:52:22 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:22 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2" returned: 0 in 0.708s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16e037f5-3fd1-4471-804b-80db371f9d76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:52:22 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[300907a1-eab5-42e0-9bfc-7ec2a4aa895a]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:22 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76 Nov 02 10:52:22 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:23 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76" returned: 0 in 0.698s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:23 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 Nov 02 10:52:23 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:24 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a313394-cf10-4c49-afa2-e5f56e5dc2c9 tempest-TestImageHashVerification-1517896129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c /opt/stack/data/cinder/conversion/9f25abfd-73d6-46f7-a55f-0f25861b5a0c.temp_image.5ab5fd39-67ec-483a-958d-c57e6d4cd1214toc0be7.img" returned: 0 in 8.020s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d229524f-b26c-499c-b7f4-3c27756bf3e0]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a313394-cf10-4c49-afa2-e5f56e5dc2c9 tempest-TestImageHashVerification-1517896129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:24 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2" returned: 0 in 0.721s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:24 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2 Nov 02 10:52:24 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:24 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c Nov 02 10:52:24 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:24 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76.ffd78614-155d-4812-9013-76d0f90cb3e2" returned: 0 in 0.275s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-ffd78614-155d-4812-9013-76d0f90cb3e2" released by "_delete_snapshot" :: held 2.640s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-16e037f5-3fd1-4471-804b-80db371f9d76" released by "delete_snapshot" :: held 2.689s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:24 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Created reservations ['fba5cc53-156c-491f-b1b7-ca2d4cac2387', '69871e9d-f978-4627-96a9-71552428f08e', '9562a5d2-b6be-4dbb-8717-b595e685e5b8', '696a654f-7e0e-46fb-8415-49507074542c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:24 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Delete snapshot completed successfully. Nov 02 10:52:24 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a313394-cf10-4c49-afa2-e5f56e5dc2c9 tempest-TestImageHashVerification-1517896129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c" returned: 0 in 0.638s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:24 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-4a313394-cf10-4c49-afa2-e5f56e5dc2c9 tempest-TestImageHashVerification-1517896129 None] Image conversion details: src /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c, size 1024.00 MB, duration 8.02 sec, destination /opt/stack/data/cinder/conversion/9f25abfd-73d6-46f7-a55f-0f25861b5a0c.temp_image.5ab5fd39-67ec-483a-958d-c57e6d4cd1214toc0be7.img {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:52:24 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-4a313394-cf10-4c49-afa2-e5f56e5dc2c9 tempest-TestImageHashVerification-1517896129 None] Converted 1024.00 MB image at 127.65 MB/s Nov 02 10:52:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-ffd78614-155d-4812-9013-76d0f90cb3e2-delete_snapshot" released by "delete_snapshot" :: held 3.009s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Snapshots deleted, issuing volume delete {{(pid=87084) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 10:52:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "cinder-quobyte-16e037f5-3fd1-4471-804b-80db371f9d76" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:24 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-4a313394-cf10-4c49-afa2-e5f56e5dc2c9 tempest-TestImageHashVerification-1517896129 None] 5ab5fd39-67ec-483a-958d-c57e6d4cd121 was raw, no need to convert to raw {{(pid=87084) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 10:52:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-16e037f5-3fd1-4471-804b-80db371f9d76" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f028fcd0-8ae2-42f8-9b4f-dbdd2c31fa84]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:24 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76 Nov 02 10:52:24 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:25 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76" returned: 0 in 0.412s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:25 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76 Nov 02 10:52:25 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:25 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-16e037f5-3fd1-4471-804b-80db371f9d76" returned: 0 in 0.318s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-16e037f5-3fd1-4471-804b-80db371f9d76" released by "delete_volume" :: held 0.825s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:25 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Created reservations ['a5edb9c3-8daf-485f-aaaf-1cc5bbe90368', 'af482d3e-4234-4dff-85d8-eca8427a3348', 'cd66a8cd-9aaf-4055-99af-8b1f1da06950', 'e1667675-8b7f-49c9-b541-6d6f67817d0f'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:25 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:52:25 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:26 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.312s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:26 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:26 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Deleted volume successfully. Nov 02 10:52:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c060f910-5ca3-4c29-ab04-a6bae26dfb7e tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-16e037f5-3fd1-4471-804b-80db371f9d76-delete_volume" released by "delete_volume" :: held 9.656s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:27 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=93,cinder:UPDATE=74,cinder:DELETE=6,cinder:INSERT=22 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:52:28 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=95,cinder:SELECT=70,cinder:INSERT=20,cinder:DELETE=7 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:52:28 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Flow 'volume_create_manager' (a95e45e3-0505-47e8-bc4f-8c9979608d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515783f9-9502-4617-968e-3b15f40b71b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515783f9-9502-4617-968e-3b15f40b71b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-443335532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717b2027-bdbb-4a03-a985-7fb066697ff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e35c14de514aabb687a5175d2efb24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:28Z,use_quota=True,user_id='7605dcd94b604d338dfc0962278952bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4a16d5-71f9-4971-a008-53cc9f85594d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4a16d5-71f9-4971-a008-53cc9f85594d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a41c21-69c8-447e-a08b-9dcb980b1c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a41c21-69c8-447e-a08b-9dcb980b1c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '717b2027-bdbb-4a03-a985-7fb066697ff1', 'volume_name': 'volume-717b2027-bdbb-4a03-a985-7fb066697ff1', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b808ab-aa97-4e18-a628-d3a0a2ba8b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b808ab-aa97-4e18-a628-d3a0a2ba8b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb378747-7e65-4b8f-80be-fe0cc9352477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:28 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Volume 717b2027-bdbb-4a03-a985-7fb066697ff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-717b2027-bdbb-4a03-a985-7fb066697ff1', 'volume_size': 1} Nov 02 10:52:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:38 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:52:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4a313394-cf10-4c49-afa2-e5f56e5dc2c9 tempest-TestImageHashVerification-1517896129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.890s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a313394-cf10-4c49-afa2-e5f56e5dc2c9 tempest-TestImageHashVerification-1517896129 None] Uploaded volume to glance image-id: 5ab5fd39-67ec-483a-958d-c57e6d4cd121. {{(pid=87084) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 10:52:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.597s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1507482648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a0c9db-03e1-4de4-b393-62486a313c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a71ef6e33442ccb46d485f73c896b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:19Z,use_quota=True,user_id='3ceea3b68ef4430b8b98cd2abf145653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:52:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Creating volume 84a0c9db-03e1-4de4-b393-62486a313c5a {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:47 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:52:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-84a0c9db-03e1-4de4-b393-62486a313c5a 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:47 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-84a0c9db-03e1-4de4-b393-62486a313c5a 1073741824 Nov 02 10:52:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4a313394-cf10-4c49-afa2-e5f56e5dc2c9 tempest-TestImageHashVerification-1517896129 None] Copy volume to image completed successfully. Nov 02 10:52:47 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:47 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-84a0c9db-03e1-4de4-b393-62486a313c5a 1073741824" returned: 0 in 0.607s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-84a0c9db-03e1-4de4-b393-62486a313c5a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:47 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-84a0c9db-03e1-4de4-b393-62486a313c5a Nov 02 10:52:47 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6804b34b-b47a-425a-a515-6f7c9203f7ad tempest-TestImageHashVerification-1517896129 None] Acquiring lock "cinder-9f25abfd-73d6-46f7-a55f-0f25861b5a0c-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6804b34b-b47a-425a-a515-6f7c9203f7ad tempest-TestImageHashVerification-1517896129 None] Lock "cinder-9f25abfd-73d6-46f7-a55f-0f25861b5a0c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:48 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-84a0c9db-03e1-4de4-b393-62486a313c5a" returned: 0 in 0.309s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.936s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-443335532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717b2027-bdbb-4a03-a985-7fb066697ff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e35c14de514aabb687a5175d2efb24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:28Z,use_quota=True,user_id='7605dcd94b604d338dfc0962278952bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Creating volume 717b2027-bdbb-4a03-a985-7fb066697ff1 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:48 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:48 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1 1073741824 Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0dd6ad-7fde-43e5-8e72-c945a3b0f3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a0c9db-03e1-4de4-b393-62486a313c5a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:48 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999f1842-876c-4523-9605-182f724fdcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6804b34b-b47a-425a-a515-6f7c9203f7ad tempest-TestImageHashVerification-1517896129 None] Acquiring lock "cinder-quobyte-9f25abfd-73d6-46f7-a55f-0f25861b5a0c" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:48 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Volume volume-84a0c9db-03e1-4de4-b393-62486a313c5a (84a0c9db-03e1-4de4-b393-62486a313c5a): created successfully Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999f1842-876c-4523-9605-182f724fdcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Flow 'volume_create_manager' (db67a8d7-45f9-4848-aee5-0ccf1eca5353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-389b71c4-e364-4a49-a09b-cbee6d772beb tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Created volume successfully. Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6804b34b-b47a-425a-a515-6f7c9203f7ad tempest-TestImageHashVerification-1517896129 None] Lock "cinder-quobyte-9f25abfd-73d6-46f7-a55f-0f25861b5a0c" acquired by "delete_volume" :: waited 0.039s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5286faa4-0450-46ce-825f-7266e54aaaad]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6804b34b-b47a-425a-a515-6f7c9203f7ad tempest-TestImageHashVerification-1517896129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:48 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c Nov 02 10:52:48 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:48 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1 1073741824" returned: 0 in 0.588s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:48 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6804b34b-b47a-425a-a515-6f7c9203f7ad tempest-TestImageHashVerification-1517896129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c" returned: 0 in 0.489s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6804b34b-b47a-425a-a515-6f7c9203f7ad tempest-TestImageHashVerification-1517896129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:48 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c Nov 02 10:52:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:48 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:48 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1 Nov 02 10:52:48 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:49 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6804b34b-b47a-425a-a515-6f7c9203f7ad tempest-TestImageHashVerification-1517896129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9f25abfd-73d6-46f7-a55f-0f25861b5a0c" returned: 0 in 0.344s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6804b34b-b47a-425a-a515-6f7c9203f7ad tempest-TestImageHashVerification-1517896129 None] Lock "cinder-quobyte-9f25abfd-73d6-46f7-a55f-0f25861b5a0c" released by "delete_volume" :: held 0.892s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:49 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1" returned: 0 in 0.329s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb378747-7e65-4b8f-80be-fe0cc9352477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-717b2027-bdbb-4a03-a985-7fb066697ff1', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2134e91e-a70a-4498-8b56-0fb6ec845147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:49 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Volume volume-717b2027-bdbb-4a03-a985-7fb066697ff1 (717b2027-bdbb-4a03-a985-7fb066697ff1): created successfully Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2134e91e-a70a-4498-8b56-0fb6ec845147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Flow 'volume_create_manager' (a95e45e3-0505-47e8-bc4f-8c9979608d9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-01fae3f8-ae9f-4d7a-93eb-6f8183a6e47d tempest-VolumesDeleteCascade-1648389586 None] Created volume successfully. Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-6804b34b-b47a-425a-a515-6f7c9203f7ad tempest-TestImageHashVerification-1517896129 None] Created reservations ['5ce06600-cbe9-437d-9669-3736b87beb77', '5c45dbff-8855-4a79-8b7c-91e6e1651ace', 'a29e3e9d-5aa3-4ee8-9c17-485c1da32bfe', 'dfa1af08-2373-439f-b506-7875ee7a53e7'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6804b34b-b47a-425a-a515-6f7c9203f7ad tempest-TestImageHashVerification-1517896129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6804b34b-b47a-425a-a515-6f7c9203f7ad tempest-TestImageHashVerification-1517896129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6804b34b-b47a-425a-a515-6f7c9203f7ad tempest-TestImageHashVerification-1517896129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6804b34b-b47a-425a-a515-6f7c9203f7ad tempest-TestImageHashVerification-1517896129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6804b34b-b47a-425a-a515-6f7c9203f7ad tempest-TestImageHashVerification-1517896129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6804b34b-b47a-425a-a515-6f7c9203f7ad tempest-TestImageHashVerification-1517896129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:49 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:52:49 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:49 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6804b34b-b47a-425a-a515-6f7c9203f7ad tempest-TestImageHashVerification-1517896129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.305s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-6804b34b-b47a-425a-a515-6f7c9203f7ad tempest-TestImageHashVerification-1517896129 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6804b34b-b47a-425a-a515-6f7c9203f7ad tempest-TestImageHashVerification-1517896129 None] Deleted volume successfully. Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6804b34b-b47a-425a-a515-6f7c9203f7ad tempest-TestImageHashVerification-1517896129 None] Lock "cinder-9f25abfd-73d6-46f7-a55f-0f25861b5a0c-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-26b6cdda-7c9f-4f1b-bf91-d38c4ee62853 req-c89d4854-019d-4802-89a4-8f1e0ceab8dc tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-26b6cdda-7c9f-4f1b-bf91-d38c4ee62853 req-c89d4854-019d-4802-89a4-8f1e0ceab8dc tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-26b6cdda-7c9f-4f1b-bf91-d38c4ee62853 req-c89d4854-019d-4802-89a4-8f1e0ceab8dc tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-26b6cdda-7c9f-4f1b-bf91-d38c4ee62853 req-c89d4854-019d-4802-89a4-8f1e0ceab8dc tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-84a0c9db-03e1-4de4-b393-62486a313c5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f009203-d703-47c7-8aeb-6d52525fd173', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:52:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-26b6cdda-7c9f-4f1b-bf91-d38c4ee62853 req-c89d4854-019d-4802-89a4-8f1e0ceab8dc tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] attachment_update completed successfully. Nov 02 10:52:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9afce54c-8b1f-45eb-a1fe-c7a47e7c4902 tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9afce54c-8b1f-45eb-a1fe-c7a47e7c4902 tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9afce54c-8b1f-45eb-a1fe-c7a47e7c4902 tempest-VolumesDeleteCascade-1648389586 None] Creating offline snapshot c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251 of volume 717b2027-bdbb-4a03-a985-7fb066697ff1 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:52:50 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fb5a3c-ba8c-4965-b98b-3f4457c6a382]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9afce54c-8b1f-45eb-a1fe-c7a47e7c4902 tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:50 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1 Nov 02 10:52:50 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:50 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Flow 'volume_create_manager' (be263e2a-8289-447b-9375-1bedb29e06cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b5add5f-e680-4bda-8787-09ad384dcb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b5add5f-e680-4bda-8787-09ad384dcb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-914681368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e163ee2-32e0-427d-b5b3-90347a892262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2623e5d74bdb40f38daea7bf86b6b893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:50Z,use_quota=True,user_id='54117e4045e240499fc4d455643554d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68580cde-5ce2-4de7-abe0-18a21d2acc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68580cde-5ce2-4de7-abe0-18a21d2acc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df76ab47-7f90-4523-b787-7c5ffe4567a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:50 devstack cinder-volume[87084]: DEBUG cinder.image.glance [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Creating Keystone auth plugin from conf {{(pid=87084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:52:50 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9afce54c-8b1f-45eb-a1fe-c7a47e7c4902 tempest-VolumesDeleteCascade-1648389586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1" returned: 0 in 0.493s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9afce54c-8b1f-45eb-a1fe-c7a47e7c4902 tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:50 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251 1G Nov 02 10:52:50 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df76ab47-7f90-4523-b787-7c5ffe4567a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6e163ee2-32e0-427d-b5b3-90347a892262', 'volume_name': 'volume-6e163ee2-32e0-427d-b5b3-90347a892262', 'volume_size': 1, 'image_id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9af457eb3c6844a99ee880354ae43eac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'created_at': datetime.datetime(2026, 11, 2, 9, 33, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0223-61d3-44de-a27f-c6e0b6ba1310/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96fb2e3-08f8-4e0d-a33c-b69b5ec7c8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96fb2e3-08f8-4e0d-a33c-b69b5ec7c8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52c2f7b-c3ac-44e8-8310-d71914ab9ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:51 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Volume 6e163ee2-32e0-427d-b5b3-90347a892262: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6e163ee2-32e0-427d-b5b3-90347a892262', 'volume_size': 1, 'image_id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9af457eb3c6844a99ee880354ae43eac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'created_at': datetime.datetime(2026, 11, 2, 9, 33, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0223-61d3-44de-a27f-c6e0b6ba1310/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:52:51 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Trying to clone 6e163ee2-32e0-427d-b5b3-90347a892262 from image 918d0223-61d3-44de-a27f-c6e0b6ba1310 at location (None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}]). {{(pid=87084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:52:51 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9afce54c-8b1f-45eb-a1fe-c7a47e7c4902 tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251 1G" returned: 0 in 0.641s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9afce54c-8b1f-45eb-a1fe-c7a47e7c4902 tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-717b2027-bdbb-4a03-a985-7fb066697ff1 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:51 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-717b2027-bdbb-4a03-a985-7fb066697ff1 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251 Nov 02 10:52:51 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:51 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_dnb_hor1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:52:51 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:52:51 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[955e4737-3ac3-4a4c-acf8-9a7156e924d6]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_dnb_hor1devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:51 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_dnb_hor1devstack@QuobyteHD Nov 02 10:52:51 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:51 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9afce54c-8b1f-45eb-a1fe-c7a47e7c4902 tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-717b2027-bdbb-4a03-a985-7fb066697ff1 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251" returned: 0 in 0.443s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:51 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-9afce54c-8b1f-45eb-a1fe-c7a47e7c4902 tempest-VolumesDeleteCascade-1648389586 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251 is being set with open permissions: ugo+rw Nov 02 10:52:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9afce54c-8b1f-45eb-a1fe-c7a47e7c4902 tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:51 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251 Nov 02 10:52:51 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:52 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_dnb_hor1devstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Temporary image 918d0223-61d3-44de-a27f-c6e0b6ba1310 is fetched for user 54117e4045e240499fc4d455643554d6. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:52:52 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9afce54c-8b1f-45eb-a1fe-c7a47e7c4902 tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251" returned: 0 in 0.288s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[191564c2-bc03-45f2-9bb1-5c6970db523a]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_dnb_hor1devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9afce54c-8b1f-45eb-a1fe-c7a47e7c4902 tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:52 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.info Nov 02 10:52:52 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:52 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_dnb_hor1devstack@QuobyteHD Nov 02 10:52:52 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:52 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9afce54c-8b1f-45eb-a1fe-c7a47e7c4902 tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.info" returned: 0 in 0.347s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:52 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-9afce54c-8b1f-45eb-a1fe-c7a47e7c4902 tempest-VolumesDeleteCascade-1648389586 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.info is being set with open permissions: ugo+rw Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9afce54c-8b1f-45eb-a1fe-c7a47e7c4902 tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:52 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.info Nov 02 10:52:52 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:52 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_dnb_hor1devstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:52 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9afce54c-8b1f-45eb-a1fe-c7a47e7c4902 tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.info" returned: 0 in 0.279s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9afce54c-8b1f-45eb-a1fe-c7a47e7c4902 tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.662s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.231s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-914681368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e163ee2-32e0-427d-b5b3-90347a892262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2623e5d74bdb40f38daea7bf86b6b893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:50Z,use_quota=True,user_id='54117e4045e240499fc4d455643554d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Creating volume 6e163ee2-32e0-427d-b5b3-90347a892262 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:52 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:52:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6e163ee2-32e0-427d-b5b3-90347a892262 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:52 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6e163ee2-32e0-427d-b5b3-90347a892262 1073741824 Nov 02 10:52:52 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:52 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9afce54c-8b1f-45eb-a1fe-c7a47e7c4902 tempest-VolumesDeleteCascade-1648389586 None] Create snapshot completed successfully Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:53 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:52:53 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:53 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6e163ee2-32e0-427d-b5b3-90347a892262 1073741824" returned: 0 in 0.586s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6e163ee2-32e0-427d-b5b3-90347a892262 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:53 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6e163ee2-32e0-427d-b5b3-90347a892262 Nov 02 10:52:53 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:53 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.457s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:52:53 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6e163ee2-32e0-427d-b5b3-90347a892262" returned: 0 in 0.316s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Attempting download of 918d0223-61d3-44de-a27f-c6e0b6ba1310 ((None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}])) to volume 6e163ee2-32e0-427d-b5b3-90347a892262. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[613aacb9-f4c9-457a-9b74-1730a0096314]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310__g2pkr90 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:53 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-fb651534-a9b9-4bee-811e-f8e5a451018d req-602a3cc6-9c59-414f-acc3-459f8c5ea2bf tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Terminate volume connection completed successfully. Nov 02 10:52:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-fb651534-a9b9-4bee-811e-f8e5a451018d req-602a3cc6-9c59-414f-acc3-459f8c5ea2bf tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Deleting attachment 9f009203-d703-47c7-8aeb-6d52525fd173. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:52:54 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310__g2pkr90 Nov 02 10:52:54 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Flow 'volume_create_manager' (f3d0d8a3-fef3-4a7c-a699-bc5c6d2c0293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03d000c-a587-4ce8-985f-ab1459d74895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03d000c-a587-4ce8-985f-ab1459d74895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2072682867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a447e383-35e0-4489-b064-e311fe6adc25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e35c14de514aabb687a5175d2efb24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:54Z,use_quota=True,user_id='7605dcd94b604d338dfc0962278952bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef793f90-8e41-45de-b575-62b54a7f5710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef793f90-8e41-45de-b575-62b54a7f5710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52abf404-fd58-4478-8e20-1d0640e15ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52abf404-fd58-4478-8e20-1d0640e15ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a447e383-35e0-4489-b064-e311fe6adc25', 'volume_name': 'volume-a447e383-35e0-4489-b064-e311fe6adc25', 'volume_size': 1, 'snapshot_id': 'c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778f73ef-c962-440f-9528-80dd51ac2aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778f73ef-c962-440f-9528-80dd51ac2aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d6264d-4c37-4fb5-b10f-d4128b0bc99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:54 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Volume a447e383-35e0-4489-b064-e311fe6adc25: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a447e383-35e0-4489-b064-e311fe6adc25', 'volume_size': 1, 'snapshot_id': 'c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251'} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "cinder-quobyte-c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251-a447e383-35e0-4489-b064-e311fe6adc25" by "_create_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:54 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251-a447e383-35e0-4489-b064-e311fe6adc25" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Creating volume a447e383-35e0-4489-b064-e311fe6adc25 from snapshot c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251 {{(pid=87084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "cinder-quobyte-a447e383-35e0-4489-b064-e311fe6adc25" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310__g2pkr90" returned: 0 in 0.396s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310__g2pkr90 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-a447e383-35e0-4489-b064-e311fe6adc25" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] snapshot: c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251, volume: a447e383-35e0-4489-b064-e311fe6adc25, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bfbf3b-37b2-4fe8-918a-0b2504079432]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:54 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310__g2pkr90 Nov 02 10:52:54 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2463e0a8-db3b-4293-a619-db21f8361179 tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Acquiring lock "cinder-84a0c9db-03e1-4de4-b393-62486a313c5a-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2463e0a8-db3b-4293-a619-db21f8361179 tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Lock "cinder-84a0c9db-03e1-4de4-b393-62486a313c5a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:54 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251 Nov 02 10:52:54 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2463e0a8-db3b-4293-a619-db21f8361179 tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Acquiring lock "cinder-quobyte-84a0c9db-03e1-4de4-b393-62486a313c5a" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2463e0a8-db3b-4293-a619-db21f8361179 tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Lock "cinder-quobyte-84a0c9db-03e1-4de4-b393-62486a313c5a" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbd8c68-358d-46ae-b529-41209d9fa4d7]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2463e0a8-db3b-4293-a619-db21f8361179 tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-84a0c9db-03e1-4de4-b393-62486a313c5a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:54 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-84a0c9db-03e1-4de4-b393-62486a313c5a Nov 02 10:52:54 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:54 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310__g2pkr90" returned: 1 in 0.616s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310__g2pkr90' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63cc14b-afba-4d77-b2c8-d1eb39e73e20]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_dnb_hor1devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:54 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251" returned: 0 in 0.546s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-717b2027-bdbb-4a03-a985-7fb066697ff1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17c8445-e3ed-4cb7-9c06-1c38375a5dec]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:55 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_dnb_hor1devstack@QuobyteHD Nov 02 10:52:55 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:55 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1 Nov 02 10:52:55 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:55 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2463e0a8-db3b-4293-a619-db21f8361179 tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-84a0c9db-03e1-4de4-b393-62486a313c5a" returned: 0 in 0.533s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2463e0a8-db3b-4293-a619-db21f8361179 tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-84a0c9db-03e1-4de4-b393-62486a313c5a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:55 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-84a0c9db-03e1-4de4-b393-62486a313c5a Nov 02 10:52:55 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:55 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_dnb_hor1devstack@QuobyteHD" returned: 0 in 0.487s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:55 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] 918d0223-61d3-44de-a27f-c6e0b6ba1310 was qcow2, converting to qcow2 {{(pid=87084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:52:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_dnb_hor1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6e163ee2-32e0-427d-b5b3-90347a892262 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:55 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_dnb_hor1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6e163ee2-32e0-427d-b5b3-90347a892262 Nov 02 10:52:55 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:55 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1" returned: 0 in 0.498s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1 {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:52:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:52:55 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Path /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a447e383-35e0-4489-b064-e311fe6adc25 not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:52:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a447e383-35e0-4489-b064-e311fe6adc25 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:55 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a447e383-35e0-4489-b064-e311fe6adc25 Nov 02 10:52:55 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:55 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2463e0a8-db3b-4293-a619-db21f8361179 tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-84a0c9db-03e1-4de4-b393-62486a313c5a" returned: 0 in 0.441s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2463e0a8-db3b-4293-a619-db21f8361179 tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Lock "cinder-quobyte-84a0c9db-03e1-4de4-b393-62486a313c5a" released by "delete_volume" :: held 1.119s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:55 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-2463e0a8-db3b-4293-a619-db21f8361179 tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Created reservations ['d77f268b-18f0-4b78-9550-34d341ca696f', '4cfc00d0-5b47-4087-b75e-887cb250167c', '3097e4ab-5883-4a3d-92b6-bdf442c6d5e6', 'abebae2d-2aca-44df-9577-b95c12f90fc2'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2463e0a8-db3b-4293-a619-db21f8361179 tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2463e0a8-db3b-4293-a619-db21f8361179 tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2463e0a8-db3b-4293-a619-db21f8361179 tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2463e0a8-db3b-4293-a619-db21f8361179 tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2463e0a8-db3b-4293-a619-db21f8361179 tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2463e0a8-db3b-4293-a619-db21f8361179 tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:55 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:52:55 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:56 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2463e0a8-db3b-4293-a619-db21f8361179 tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.650s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:56 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-2463e0a8-db3b-4293-a619-db21f8361179 tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:56 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2463e0a8-db3b-4293-a619-db21f8361179 tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Deleted volume successfully. Nov 02 10:52:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2463e0a8-db3b-4293-a619-db21f8361179 tempest-TestServerVolumeAttachScenarioOldVersion-690879166 None] Lock "cinder-84a0c9db-03e1-4de4-b393-62486a313c5a-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:00 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_dnb_hor1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6e163ee2-32e0-427d-b5b3-90347a892262" returned: 0 in 5.563s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:00 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_dnb_hor1devstack@QuobyteHD, size 112.00 MB, duration 5.56 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6e163ee2-32e0-427d-b5b3-90347a892262 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:53:00 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Converted 112.00 MB image at 20.13 MB/s Nov 02 10:53:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6e163ee2-32e0-427d-b5b3-90347a892262 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:01 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6e163ee2-32e0-427d-b5b3-90347a892262 1G Nov 02 10:53:01 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:01 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6e163ee2-32e0-427d-b5b3-90347a892262 1G" returned: 0 in 0.802s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:01 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Downloaded image 918d0223-61d3-44de-a27f-c6e0b6ba1310 ((None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}])) to volume 6e163ee2-32e0-427d-b5b3-90347a892262 successfully. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:53:01 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Temporary image 918d0223-61d3-44de-a27f-c6e0b6ba1310 for user 54117e4045e240499fc4d455643554d6 is deleted. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:53:01 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Marking volume 6e163ee2-32e0-427d-b5b3-90347a892262 as bootable. {{(pid=87084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:53:01 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Copying metadata from image 918d0223-61d3-44de-a27f-c6e0b6ba1310 to 6e163ee2-32e0-427d-b5b3-90347a892262. {{(pid=87084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:53:01 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Creating volume glance metadata for volume 6e163ee2-32e0-427d-b5b3-90347a892262 backed by image 918d0223-61d3-44de-a27f-c6e0b6ba1310 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:53:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52c2f7b-c3ac-44e8-8310-d71914ab9ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e163ee2-32e0-427d-b5b3-90347a892262', 'volume_size': 1, 'image_id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9af457eb3c6844a99ee880354ae43eac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'created_at': datetime.datetime(2026, 11, 2, 9, 33, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0223-61d3-44de-a27f-c6e0b6ba1310/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd33c5c8-124d-4f71-b826-b7ffbf32b505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:02 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Volume volume-6e163ee2-32e0-427d-b5b3-90347a892262 (6e163ee2-32e0-427d-b5b3-90347a892262): created successfully Nov 02 10:53:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd33c5c8-124d-4f71-b826-b7ffbf32b505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Flow 'volume_create_manager' (be263e2a-8289-447b-9375-1bedb29e06cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:02 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c421e184-7542-415d-9c27-eefd09e49c37 tempest-TestShelveInstance-1326132134 None] Created volume successfully. Nov 02 10:53:04 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a447e383-35e0-4489-b064-e311fe6adc25" returned: 0 in 8.869s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:04 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Image conversion details: src /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1, size 1024.00 MB, duration 8.87 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a447e383-35e0-4489-b064-e311fe6adc25 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:53:04 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Converted 1024.00 MB image at 115.45 MB/s Nov 02 10:53:04 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a447e383-35e0-4489-b064-e311fe6adc25 is being set with open permissions: ugo+rw Nov 02 10:53:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a447e383-35e0-4489-b064-e311fe6adc25 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:04 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a447e383-35e0-4489-b064-e311fe6adc25 Nov 02 10:53:04 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:04 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a447e383-35e0-4489-b064-e311fe6adc25" returned: 0 in 0.247s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-a447e383-35e0-4489-b064-e311fe6adc25" released by "_copy_volume_from_snapshot" :: held 10.311s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251-a447e383-35e0-4489-b064-e311fe6adc25" released by "_create_volume_from_snapshot" :: held 10.411s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.431s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d6264d-4c37-4fb5-b10f-d4128b0bc99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a447e383-35e0-4489-b064-e311fe6adc25', 'volume_size': 1, 'snapshot_id': 'c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f37b7d-7c62-4509-bcdc-d7eed91a3f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:04 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Volume volume-a447e383-35e0-4489-b064-e311fe6adc25 (a447e383-35e0-4489-b064-e311fe6adc25): created successfully Nov 02 10:53:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f37b7d-7c62-4509-bcdc-d7eed91a3f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Flow 'volume_create_manager' (f3d0d8a3-fef3-4a7c-a699-bc5c6d2c0293) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:04 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-04b1d574-efd8-47b8-9a0d-783516caeebc tempest-VolumesDeleteCascade-1648389586 None] Created volume successfully. Nov 02 10:53:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "cinder-717b2027-bdbb-4a03-a985-7fb066697ff1-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-717b2027-bdbb-4a03-a985-7fb066697ff1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Performing cascade delete. {{(pid=87084) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 10:53:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "cinder-c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "cinder-quobyte-717b2027-bdbb-4a03-a985-7fb066697ff1" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-717b2027-bdbb-4a03-a985-7fb066697ff1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "cinder-quobyte-c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Deleting offline snapshot c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251 of volume 717b2027-bdbb-4a03-a985-7fb066697ff1 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:53:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] snapshot_file for this snap is: volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:53:05 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c6e7b4-d2b6-4aec-b67f-52f6df5767e7]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:05 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251 Nov 02 10:53:05 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:06 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251" returned: 0 in 0.397s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-717b2027-bdbb-4a03-a985-7fb066697ff1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:53:06 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e68b04-61ac-4b15-b245-166f959bd0a4]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:06 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1 Nov 02 10:53:06 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:07 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1" returned: 0 in 0.731s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:07 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251 Nov 02 10:53:07 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:07 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251" returned: 0 in 0.401s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:07 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251 Nov 02 10:53:07 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:07 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1.c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251" returned: 0 in 0.325s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251" released by "_delete_snapshot" :: held 2.014s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-717b2027-bdbb-4a03-a985-7fb066697ff1" released by "delete_snapshot" :: held 2.049s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:07 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Created reservations ['53df7bc3-79eb-4554-bfcc-66279c7f4187', '30c9dbd1-14b7-4545-bc9e-b69cf65018eb', '79c5122d-8b39-42ec-9dd4-36335dd37bee', '41e61781-68b7-4c5b-9d71-bf3d1e853ed3'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:07 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Delete snapshot completed successfully. Nov 02 10:53:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-c5c2a59e-7a72-481f-a0a2-fb2fc3d4c251-delete_snapshot" released by "delete_snapshot" :: held 2.277s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Snapshots deleted, issuing volume delete {{(pid=87084) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 10:53:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "cinder-quobyte-717b2027-bdbb-4a03-a985-7fb066697ff1" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-717b2027-bdbb-4a03-a985-7fb066697ff1" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:08 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f38952a-c400-493b-b386-72d3b1087c20]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:08 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1 Nov 02 10:53:08 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:08 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1" returned: 0 in 0.417s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:08 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1 Nov 02 10:53:08 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-e3be3fb3-7047-42cc-b3e9-4c84642648f0 req-53feaaca-95e7-4d17-b127-50b6aea62e83 tempest-TestShelveInstance-1326132134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-e3be3fb3-7047-42cc-b3e9-4c84642648f0 req-53feaaca-95e7-4d17-b127-50b6aea62e83 tempest-TestShelveInstance-1326132134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-e3be3fb3-7047-42cc-b3e9-4c84642648f0 req-53feaaca-95e7-4d17-b127-50b6aea62e83 tempest-TestShelveInstance-1326132134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-e3be3fb3-7047-42cc-b3e9-4c84642648f0 req-53feaaca-95e7-4d17-b127-50b6aea62e83 tempest-TestShelveInstance-1326132134 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-6e163ee2-32e0-427d-b5b3-90347a892262', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb680748-edff-4f6d-b8d3-e8e5b6a57ea9', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:53:08 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-e3be3fb3-7047-42cc-b3e9-4c84642648f0 req-53feaaca-95e7-4d17-b127-50b6aea62e83 tempest-TestShelveInstance-1326132134 None] attachment_update completed successfully. Nov 02 10:53:08 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-717b2027-bdbb-4a03-a985-7fb066697ff1" returned: 0 in 0.442s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-717b2027-bdbb-4a03-a985-7fb066697ff1" released by "delete_volume" :: held 0.952s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:09 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Created reservations ['b918a14c-4e4a-4ecf-a56d-7879cbee5f70', 'd06747cb-3d98-4110-9060-0a3f33d6f256', '14abe7bc-cbab-4d18-8739-50719e569d99', 'a1c02451-8331-42ca-9e05-aee410d562d9'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:09 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:53:09 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:09 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.398s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:09 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:09 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Deleted volume successfully. Nov 02 10:53:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a886c034-37e1-48fc-bd29-161dc7e714cf tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-717b2027-bdbb-4a03-a985-7fb066697ff1-delete_volume" released by "delete_volume" :: held 3.927s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-413e48b2-9cdd-402f-966f-bcdd22972216 tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "cinder-a447e383-35e0-4489-b064-e311fe6adc25-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-413e48b2-9cdd-402f-966f-bcdd22972216 tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-a447e383-35e0-4489-b064-e311fe6adc25-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-413e48b2-9cdd-402f-966f-bcdd22972216 tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "cinder-quobyte-a447e383-35e0-4489-b064-e311fe6adc25" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-413e48b2-9cdd-402f-966f-bcdd22972216 tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-a447e383-35e0-4489-b064-e311fe6adc25" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:10 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6646aa30-2911-492c-ad88-336183534a85]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-413e48b2-9cdd-402f-966f-bcdd22972216 tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a447e383-35e0-4489-b064-e311fe6adc25 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:10 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a447e383-35e0-4489-b064-e311fe6adc25 Nov 02 10:53:10 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:10 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-413e48b2-9cdd-402f-966f-bcdd22972216 tempest-VolumesDeleteCascade-1648389586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a447e383-35e0-4489-b064-e311fe6adc25" returned: 0 in 0.485s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-413e48b2-9cdd-402f-966f-bcdd22972216 tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a447e383-35e0-4489-b064-e311fe6adc25 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:10 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a447e383-35e0-4489-b064-e311fe6adc25 Nov 02 10:53:10 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:11 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-413e48b2-9cdd-402f-966f-bcdd22972216 tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a447e383-35e0-4489-b064-e311fe6adc25" returned: 0 in 0.363s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-413e48b2-9cdd-402f-966f-bcdd22972216 tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-quobyte-a447e383-35e0-4489-b064-e311fe6adc25" released by "delete_volume" :: held 0.917s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:11 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-413e48b2-9cdd-402f-966f-bcdd22972216 tempest-VolumesDeleteCascade-1648389586 None] Created reservations ['7326ea01-93a2-4dbb-a345-4052d8a3108a', 'f264b7ad-37bc-4d94-a69f-c4542cb7e84a', 'febfa7b6-0d2a-4f3e-8f86-e31e4c2ff4cd', '4cb4611e-b5b2-4bba-85cb-6478f3d178f0'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-413e48b2-9cdd-402f-966f-bcdd22972216 tempest-VolumesDeleteCascade-1648389586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-413e48b2-9cdd-402f-966f-bcdd22972216 tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-413e48b2-9cdd-402f-966f-bcdd22972216 tempest-VolumesDeleteCascade-1648389586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-413e48b2-9cdd-402f-966f-bcdd22972216 tempest-VolumesDeleteCascade-1648389586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-413e48b2-9cdd-402f-966f-bcdd22972216 tempest-VolumesDeleteCascade-1648389586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-413e48b2-9cdd-402f-966f-bcdd22972216 tempest-VolumesDeleteCascade-1648389586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:11 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:53:11 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:11 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Flow 'volume_create_manager' (4feb8b5f-96d7-417a-8e59-4c4a8a53a817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2cec946-8b02-43eb-b9c1-aa3089de7f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:11 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-413e48b2-9cdd-402f-966f-bcdd22972216 tempest-VolumesDeleteCascade-1648389586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.334s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:11 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-413e48b2-9cdd-402f-966f-bcdd22972216 tempest-VolumesDeleteCascade-1648389586 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2cec946-8b02-43eb-b9c1-aa3089de7f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2038865805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc367af2-f924-4f9e-a655-329b874b5585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c7af84565934d34a03a953dd5d87d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:12Z,use_quota=True,user_id='69bd7f375efb4e0bacf65d8388dd56cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0905916c-42bb-4bde-b7e5-4d12174598fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0905916c-42bb-4bde-b7e5-4d12174598fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe21370-30ad-4d80-9e50-caf2c53afc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe21370-30ad-4d80-9e50-caf2c53afc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc367af2-f924-4f9e-a655-329b874b5585', 'volume_name': 'volume-bc367af2-f924-4f9e-a655-329b874b5585', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04976af3-b68a-4951-b22c-0f8f903b9651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04976af3-b68a-4951-b22c-0f8f903b9651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c3b408b-4db7-4f86-93ff-1f18d5af5859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:12 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Volume bc367af2-f924-4f9e-a655-329b874b5585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc367af2-f924-4f9e-a655-329b874b5585', 'volume_size': 1} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2038865805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc367af2-f924-4f9e-a655-329b874b5585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c7af84565934d34a03a953dd5d87d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:12Z,use_quota=True,user_id='69bd7f375efb4e0bacf65d8388dd56cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Creating volume bc367af2-f924-4f9e-a655-329b874b5585 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:12 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc367af2-f924-4f9e-a655-329b874b5585 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:12 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-413e48b2-9cdd-402f-966f-bcdd22972216 tempest-VolumesDeleteCascade-1648389586 None] Deleted volume successfully. Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-413e48b2-9cdd-402f-966f-bcdd22972216 tempest-VolumesDeleteCascade-1648389586 None] Lock "cinder-a447e383-35e0-4489-b064-e311fe6adc25-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:12 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc367af2-f924-4f9e-a655-329b874b5585 1073741824 Nov 02 10:53:12 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Flow 'volume_create_manager' (b9d56c8c-1f62-45e8-85e6-86c1a997e98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb462b2-c9c6-4f02-bd0e-03a774b8fd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb462b2-c9c6-4f02-bd0e-03a774b8fd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-115824988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c7af84565934d34a03a953dd5d87d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:12Z,use_quota=True,user_id='69bd7f375efb4e0bacf65d8388dd56cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03de86c0-c940-4e14-82de-835c84d5a695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03de86c0-c940-4e14-82de-835c84d5a695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9844ea43-92eb-45f2-9fe6-cc3187928936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9844ea43-92eb-45f2-9fe6-cc3187928936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad', 'volume_name': 'volume-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592bb318-5ed2-4b8a-8d33-b5a3226b58e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592bb318-5ed2-4b8a-8d33-b5a3226b58e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdb6a59-72a3-4e20-8e23-74943a7a172c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:12 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Volume a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad', 'volume_size': 1} Nov 02 10:53:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:13 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc367af2-f924-4f9e-a655-329b874b5585 1073741824" returned: 0 in 1.149s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc367af2-f924-4f9e-a655-329b874b5585 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:13 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc367af2-f924-4f9e-a655-329b874b5585 Nov 02 10:53:13 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:13 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Flow 'volume_create_manager' (9a826960-79c0-4bc2-835e-53b37971f2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59cc52f-258d-4da3-8228-1f6eb6d8e8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59cc52f-258d-4da3-8228-1f6eb6d8e8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1755502007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c119f9-79cd-4466-b9f4-84129a9d08ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c7af84565934d34a03a953dd5d87d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:13Z,use_quota=True,user_id='69bd7f375efb4e0bacf65d8388dd56cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026d3177-bec9-4742-ad32-5d284d53ba6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026d3177-bec9-4742-ad32-5d284d53ba6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81301f13-b92e-4c08-8d09-4c1ce79947b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81301f13-b92e-4c08-8d09-4c1ce79947b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01c119f9-79cd-4466-b9f4-84129a9d08ce', 'volume_name': 'volume-01c119f9-79cd-4466-b9f4-84129a9d08ce', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b045b3-e061-44eb-abe4-0d1bf6008ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b045b3-e061-44eb-abe4-0d1bf6008ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d512cfd9-5e41-4ef8-a1f8-a04e3ff3b283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:13 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Volume 01c119f9-79cd-4466-b9f4-84129a9d08ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01c119f9-79cd-4466-b9f4-84129a9d08ce', 'volume_size': 1} Nov 02 10:53:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:14 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc367af2-f924-4f9e-a655-329b874b5585" returned: 0 in 0.699s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.481s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-115824988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c7af84565934d34a03a953dd5d87d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:12Z,use_quota=True,user_id='69bd7f375efb4e0bacf65d8388dd56cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Creating volume a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:14 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c3b408b-4db7-4f86-93ff-1f18d5af5859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc367af2-f924-4f9e-a655-329b874b5585', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c46384-1a2f-4160-bf45-5ae1d58ca412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:14 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad 1073741824 Nov 02 10:53:14 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:14 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Volume volume-bc367af2-f924-4f9e-a655-329b874b5585 (bc367af2-f924-4f9e-a655-329b874b5585): created successfully Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c46384-1a2f-4160-bf45-5ae1d58ca412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Flow 'volume_create_manager' (4feb8b5f-96d7-417a-8e59-4c4a8a53a817) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-307ee99c-ced9-48d1-9ea8-9032e94e552f tempest-CreateVolumesFromImageTest-1253718935 None] Created volume successfully. Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Flow 'volume_create_manager' (d963dce1-0d2a-46a9-af84-e244370466fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d33ace3-72a1-47d8-a85e-e93a39086103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d33ace3-72a1-47d8-a85e-e93a39086103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-391804006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4485ed-2f2b-4078-97f0-6f38fa7150ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c7af84565934d34a03a953dd5d87d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:14Z,use_quota=True,user_id='69bd7f375efb4e0bacf65d8388dd56cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7831c6-9775-4c46-9169-2e26471bea55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7831c6-9775-4c46-9169-2e26471bea55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab4334d-f272-4f02-9608-8a09e6be162b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab4334d-f272-4f02-9608-8a09e6be162b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d4485ed-2f2b-4078-97f0-6f38fa7150ab', 'volume_name': 'volume-8d4485ed-2f2b-4078-97f0-6f38fa7150ab', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf1f7781-7acb-47ae-9685-1a46e383e672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf1f7781-7acb-47ae-9685-1a46e383e672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570f1b93-60e0-47ed-b6b4-713409a03179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:14 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Volume 8d4485ed-2f2b-4078-97f0-6f38fa7150ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d4485ed-2f2b-4078-97f0-6f38fa7150ab', 'volume_size': 1} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:14 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad 1073741824" returned: 0 in 0.754s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:14 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad Nov 02 10:53:14 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Flow 'volume_create_manager' (2b5f25f9-93e6-4a9b-ad26-cac855c78bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb7af4d-ce67-4a81-8430-4d95b6d66524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:15 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad" returned: 0 in 0.474s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.605s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1755502007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c119f9-79cd-4466-b9f4-84129a9d08ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c7af84565934d34a03a953dd5d87d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:13Z,use_quota=True,user_id='69bd7f375efb4e0bacf65d8388dd56cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Creating volume 01c119f9-79cd-4466-b9f4-84129a9d08ce {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:15 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-01c119f9-79cd-4466-b9f4-84129a9d08ce 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:15 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-01c119f9-79cd-4466-b9f4-84129a9d08ce 1073741824 Nov 02 10:53:15 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb7af4d-ce67-4a81-8430-4d95b6d66524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-579509024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3f333c0-1da4-4c09-aae0-7d3d7191e02d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c7af84565934d34a03a953dd5d87d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:15Z,use_quota=True,user_id='69bd7f375efb4e0bacf65d8388dd56cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92877e02-602d-4828-a690-1225f9174563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92877e02-602d-4828-a690-1225f9174563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e36a64-3d52-40a2-ade0-94e254b039e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e36a64-3d52-40a2-ade0-94e254b039e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3f333c0-1da4-4c09-aae0-7d3d7191e02d', 'volume_name': 'volume-f3f333c0-1da4-4c09-aae0-7d3d7191e02d', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293da44b-8d70-41e6-9c84-e33d451b3249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293da44b-8d70-41e6-9c84-e33d451b3249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d929b81-99c2-41fd-bbb8-77b701a5a47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:15 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Volume f3f333c0-1da4-4c09-aae0-7d3d7191e02d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3f333c0-1da4-4c09-aae0-7d3d7191e02d', 'volume_size': 1} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdb6a59-72a3-4e20-8e23-74943a7a172c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca75bfa-849f-43af-81c2-be0c3b66b016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:15 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Volume volume-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad (a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad): created successfully Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca75bfa-849f-43af-81c2-be0c3b66b016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Flow 'volume_create_manager' (b9d56c8c-1f62-45e8-85e6-86c1a997e98a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:15 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-444e2f5d-d3bd-4be4-8bea-c85d68e5775d tempest-CreateVolumesFromImageTest-1253718935 None] Created volume successfully. Nov 02 10:53:16 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-01c119f9-79cd-4466-b9f4-84129a9d08ce 1073741824" returned: 0 in 0.842s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-01c119f9-79cd-4466-b9f4-84129a9d08ce {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:16 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-01c119f9-79cd-4466-b9f4-84129a9d08ce Nov 02 10:53:16 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:16 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-01c119f9-79cd-4466-b9f4-84129a9d08ce" returned: 0 in 0.475s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:53:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.163s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-391804006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4485ed-2f2b-4078-97f0-6f38fa7150ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c7af84565934d34a03a953dd5d87d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:14Z,use_quota=True,user_id='69bd7f375efb4e0bacf65d8388dd56cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:53:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Creating volume 8d4485ed-2f2b-4078-97f0-6f38fa7150ab {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:16 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:53:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8d4485ed-2f2b-4078-97f0-6f38fa7150ab 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d512cfd9-5e41-4ef8-a1f8-a04e3ff3b283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01c119f9-79cd-4466-b9f4-84129a9d08ce', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:16 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8d4485ed-2f2b-4078-97f0-6f38fa7150ab 1073741824 Nov 02 10:53:16 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc10975-4534-4f0a-af2c-5be156601a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:16 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Volume volume-01c119f9-79cd-4466-b9f4-84129a9d08ce (01c119f9-79cd-4466-b9f4-84129a9d08ce): created successfully Nov 02 10:53:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc10975-4534-4f0a-af2c-5be156601a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Flow 'volume_create_manager' (9a826960-79c0-4bc2-835e-53b37971f2e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:16 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d98e34ad-8f37-4548-aa85-8108fee6775b tempest-CreateVolumesFromImageTest-1253718935 None] Created volume successfully. Nov 02 10:53:17 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8d4485ed-2f2b-4078-97f0-6f38fa7150ab 1073741824" returned: 0 in 0.650s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8d4485ed-2f2b-4078-97f0-6f38fa7150ab {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:17 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8d4485ed-2f2b-4078-97f0-6f38fa7150ab Nov 02 10:53:17 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:17 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8d4485ed-2f2b-4078-97f0-6f38fa7150ab" returned: 0 in 0.329s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:53:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.402s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-579509024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3f333c0-1da4-4c09-aae0-7d3d7191e02d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c7af84565934d34a03a953dd5d87d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:15Z,use_quota=True,user_id='69bd7f375efb4e0bacf65d8388dd56cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:53:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Creating volume f3f333c0-1da4-4c09-aae0-7d3d7191e02d {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:17 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:53:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f3f333c0-1da4-4c09-aae0-7d3d7191e02d 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570f1b93-60e0-47ed-b6b4-713409a03179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d4485ed-2f2b-4078-97f0-6f38fa7150ab', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:18 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f3f333c0-1da4-4c09-aae0-7d3d7191e02d 1073741824 Nov 02 10:53:18 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56b2806-0c6e-4b89-95a2-f1d0f8b56f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:18 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Volume volume-8d4485ed-2f2b-4078-97f0-6f38fa7150ab (8d4485ed-2f2b-4078-97f0-6f38fa7150ab): created successfully Nov 02 10:53:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56b2806-0c6e-4b89-95a2-f1d0f8b56f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Flow 'volume_create_manager' (d963dce1-0d2a-46a9-af84-e244370466fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:18 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c9d87453-f2d8-47be-8899-81d277c2f968 tempest-CreateVolumesFromImageTest-1253718935 None] Created volume successfully. Nov 02 10:53:18 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f3f333c0-1da4-4c09-aae0-7d3d7191e02d 1073741824" returned: 0 in 1.003s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f3f333c0-1da4-4c09-aae0-7d3d7191e02d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:19 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f3f333c0-1da4-4c09-aae0-7d3d7191e02d Nov 02 10:53:19 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:19 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f3f333c0-1da4-4c09-aae0-7d3d7191e02d" returned: 0 in 0.556s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:53:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d929b81-99c2-41fd-bbb8-77b701a5a47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3f333c0-1da4-4c09-aae0-7d3d7191e02d', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411d127e-abb2-4598-adb9-45a07d3a5c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:19 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Volume volume-f3f333c0-1da4-4c09-aae0-7d3d7191e02d (f3f333c0-1da4-4c09-aae0-7d3d7191e02d): created successfully Nov 02 10:53:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411d127e-abb2-4598-adb9-45a07d3a5c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Flow 'volume_create_manager' (2b5f25f9-93e6-4a9b-ad26-cac855c78bbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:19 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-beafaa90-8a79-4b7a-a9c9-fa1c101d16c1 tempest-CreateVolumesFromImageTest-1253718935 None] Created volume successfully. Nov 02 10:53:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f96b7e4d-834b-40f1-b1cb-c5741634aae4 tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "cinder-f3f333c0-1da4-4c09-aae0-7d3d7191e02d-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f96b7e4d-834b-40f1-b1cb-c5741634aae4 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "cinder-f3f333c0-1da4-4c09-aae0-7d3d7191e02d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f96b7e4d-834b-40f1-b1cb-c5741634aae4 tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "cinder-quobyte-f3f333c0-1da4-4c09-aae0-7d3d7191e02d" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f96b7e4d-834b-40f1-b1cb-c5741634aae4 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "cinder-quobyte-f3f333c0-1da4-4c09-aae0-7d3d7191e02d" acquired by "delete_volume" :: waited 0.071s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:20 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ac5566-7913-4307-84c1-58b38dc933e0]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f96b7e4d-834b-40f1-b1cb-c5741634aae4 tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f3f333c0-1da4-4c09-aae0-7d3d7191e02d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:21 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f3f333c0-1da4-4c09-aae0-7d3d7191e02d Nov 02 10:53:21 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Flow 'volume_create_manager' (b524940e-e856-4dea-a7dd-573496bfdec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d612e2b-f02b-40b5-a84a-4b297b3f0e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d612e2b-f02b-40b5-a84a-4b297b3f0e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1471810419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908c27ca-f2a3-4def-b1d3-376d4bdd9171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c71b8eec3d44da9af0ac1cf2d29f67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:21Z,use_quota=True,user_id='a0aade8d3e6d4c12bc3eafe8ddcaf437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a4bef9-a965-4f65-ace3-6fc72f4a26f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a4bef9-a965-4f65-ace3-6fc72f4a26f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a3184f-9731-4799-8197-84cbe2e748d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a3184f-9731-4799-8197-84cbe2e748d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '908c27ca-f2a3-4def-b1d3-376d4bdd9171', 'volume_name': 'volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39616422-3769-4031-bf06-c1da2ff1fc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39616422-3769-4031-bf06-c1da2ff1fc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (151e1b4c-5393-448b-9c45-5d15b284ed65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:21 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Volume 908c27ca-f2a3-4def-b1d3-376d4bdd9171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171', 'volume_size': 1} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1471810419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908c27ca-f2a3-4def-b1d3-376d4bdd9171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c71b8eec3d44da9af0ac1cf2d29f67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:21Z,use_quota=True,user_id='a0aade8d3e6d4c12bc3eafe8ddcaf437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Creating volume 908c27ca-f2a3-4def-b1d3-376d4bdd9171 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:21 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:21 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 1073741824 Nov 02 10:53:21 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:21 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f96b7e4d-834b-40f1-b1cb-c5741634aae4 tempest-CreateVolumesFromImageTest-1253718935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f3f333c0-1da4-4c09-aae0-7d3d7191e02d" returned: 0 in 0.856s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f96b7e4d-834b-40f1-b1cb-c5741634aae4 tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f3f333c0-1da4-4c09-aae0-7d3d7191e02d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:21 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f3f333c0-1da4-4c09-aae0-7d3d7191e02d Nov 02 10:53:21 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:22 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f96b7e4d-834b-40f1-b1cb-c5741634aae4 tempest-CreateVolumesFromImageTest-1253718935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f3f333c0-1da4-4c09-aae0-7d3d7191e02d" returned: 0 in 0.513s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:22 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f96b7e4d-834b-40f1-b1cb-c5741634aae4 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "cinder-quobyte-f3f333c0-1da4-4c09-aae0-7d3d7191e02d" released by "delete_volume" :: held 1.500s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 1073741824" returned: 0 in 0.789s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:22 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 Nov 02 10:53:22 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-f96b7e4d-834b-40f1-b1cb-c5741634aae4 tempest-CreateVolumesFromImageTest-1253718935 None] Created reservations ['529019a4-3c40-4c7b-9dec-1d475f62a2d8', '60360093-e861-4dc1-938c-d3cd9497ba93', '115793d9-9001-47f6-9ad4-a90c4c16f8ba', '55391ad6-2ae8-48f5-a799-aaa4cfdd4d06'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:22 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f96b7e4d-834b-40f1-b1cb-c5741634aae4 tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f96b7e4d-834b-40f1-b1cb-c5741634aae4 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f96b7e4d-834b-40f1-b1cb-c5741634aae4 tempest-CreateVolumesFromImageTest-1253718935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f96b7e4d-834b-40f1-b1cb-c5741634aae4 tempest-CreateVolumesFromImageTest-1253718935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f96b7e4d-834b-40f1-b1cb-c5741634aae4 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f96b7e4d-834b-40f1-b1cb-c5741634aae4 tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:22 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:53:22 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:23 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171" returned: 0 in 0.521s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:53:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (151e1b4c-5393-448b-9c45-5d15b284ed65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b410e2-22cd-429e-b39b-3338cb53a115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:23 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Volume volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 (908c27ca-f2a3-4def-b1d3-376d4bdd9171): created successfully Nov 02 10:53:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b410e2-22cd-429e-b39b-3338cb53a115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Flow 'volume_create_manager' (b524940e-e856-4dea-a7dd-573496bfdec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e83eed68-d985-41a7-9d62-d3b3dbed6c31 tempest-VolumesCloneTest-441576554 None] Created volume successfully. Nov 02 10:53:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d1392d48-504f-4041-a124-e07fc1cebe59 tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "cinder-8d4485ed-2f2b-4078-97f0-6f38fa7150ab-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d1392d48-504f-4041-a124-e07fc1cebe59 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "cinder-8d4485ed-2f2b-4078-97f0-6f38fa7150ab-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:23 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f96b7e4d-834b-40f1-b1cb-c5741634aae4 tempest-CreateVolumesFromImageTest-1253718935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.610s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:23 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-f96b7e4d-834b-40f1-b1cb-c5741634aae4 tempest-CreateVolumesFromImageTest-1253718935 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d1392d48-504f-4041-a124-e07fc1cebe59 tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "cinder-quobyte-8d4485ed-2f2b-4078-97f0-6f38fa7150ab" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f96b7e4d-834b-40f1-b1cb-c5741634aae4 tempest-CreateVolumesFromImageTest-1253718935 None] Deleted volume successfully. Nov 02 10:53:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d1392d48-504f-4041-a124-e07fc1cebe59 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "cinder-quobyte-8d4485ed-2f2b-4078-97f0-6f38fa7150ab" acquired by "delete_volume" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f96b7e4d-834b-40f1-b1cb-c5741634aae4 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "cinder-f3f333c0-1da4-4c09-aae0-7d3d7191e02d-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:23 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffface1-7cfa-47ad-98d8-eee14ddeb0eb]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1392d48-504f-4041-a124-e07fc1cebe59 tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8d4485ed-2f2b-4078-97f0-6f38fa7150ab {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:23 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8d4485ed-2f2b-4078-97f0-6f38fa7150ab Nov 02 10:53:23 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:24 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1392d48-504f-4041-a124-e07fc1cebe59 tempest-CreateVolumesFromImageTest-1253718935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8d4485ed-2f2b-4078-97f0-6f38fa7150ab" returned: 0 in 0.783s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1392d48-504f-4041-a124-e07fc1cebe59 tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8d4485ed-2f2b-4078-97f0-6f38fa7150ab {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:24 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8d4485ed-2f2b-4078-97f0-6f38fa7150ab Nov 02 10:53:24 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:24 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1392d48-504f-4041-a124-e07fc1cebe59 tempest-CreateVolumesFromImageTest-1253718935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8d4485ed-2f2b-4078-97f0-6f38fa7150ab" returned: 0 in 0.427s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d1392d48-504f-4041-a124-e07fc1cebe59 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "cinder-quobyte-8d4485ed-2f2b-4078-97f0-6f38fa7150ab" released by "delete_volume" :: held 1.289s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Flow 'volume_create_manager' (f02399f9-aede-4ac6-ad3e-2c2b1bda15a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477e72da-bfcd-43a9-9937-9c630653a073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477e72da-bfcd-43a9-9937-9c630653a073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-279352858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38ff28eb-9ad8-4c5b-8bdb-db9d786ef455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c71b8eec3d44da9af0ac1cf2d29f67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=908c27ca-f2a3-4def-b1d3-376d4bdd9171,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:25Z,use_quota=True,user_id='a0aade8d3e6d4c12bc3eafe8ddcaf437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (244bc60f-337e-4ce7-99b3-760806556d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (244bc60f-337e-4ce7-99b3-760806556d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726cb9f6-ec4f-4ecb-833b-8c7da72ce3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726cb9f6-ec4f-4ecb-833b-8c7da72ce3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '38ff28eb-9ad8-4c5b-8bdb-db9d786ef455', 'volume_name': 'volume-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455', 'volume_size': 2, 'source_volid': '908c27ca-f2a3-4def-b1d3-376d4bdd9171', 'source_volstatus': 'available'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618f3fdb-e33f-4580-bdcd-0181caf26e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618f3fdb-e33f-4580-bdcd-0181caf26e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87a5b6f-0f5f-4357-9b10-b6faee363d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:24 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Volume 38ff28eb-9ad8-4c5b-8bdb-db9d786ef455: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455', 'volume_size': 2, 'source_volid': '908c27ca-f2a3-4def-b1d3-376d4bdd9171', 'source_volstatus': 'available'} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:24 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Cloning volume 908c27ca-f2a3-4def-b1d3-376d4bdd9171 to volume 38ff28eb-9ad8-4c5b-8bdb-db9d786ef455 Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-d1392d48-504f-4041-a124-e07fc1cebe59 tempest-CreateVolumesFromImageTest-1253718935 None] Created reservations ['02c8f9c4-3869-493e-ba39-a5f66c360d07', '2c3291bd-b694-4453-9d07-b0a92debdeaf', '82e2dd2b-85bf-4b10-8ebc-f26cc0d19fa0', 'a86507a9-e343-4556-b653-6b3f0a6361cb'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Creating offline snapshot 76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689 of volume 908c27ca-f2a3-4def-b1d3-376d4bdd9171 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87e17d2-3080-4477-8fe4-d838af82f9d7]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d1392d48-504f-4041-a124-e07fc1cebe59 tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d1392d48-504f-4041-a124-e07fc1cebe59 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d1392d48-504f-4041-a124-e07fc1cebe59 tempest-CreateVolumesFromImageTest-1253718935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d1392d48-504f-4041-a124-e07fc1cebe59 tempest-CreateVolumesFromImageTest-1253718935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d1392d48-504f-4041-a124-e07fc1cebe59 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1392d48-504f-4041-a124-e07fc1cebe59 tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:25 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:53:25 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:25 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 Nov 02 10:53:25 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:25 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1392d48-504f-4041-a124-e07fc1cebe59 tempest-CreateVolumesFromImageTest-1253718935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.345s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:25 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-d1392d48-504f-4041-a124-e07fc1cebe59 tempest-CreateVolumesFromImageTest-1253718935 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:25 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d1392d48-504f-4041-a124-e07fc1cebe59 tempest-CreateVolumesFromImageTest-1253718935 None] Deleted volume successfully. Nov 02 10:53:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d1392d48-504f-4041-a124-e07fc1cebe59 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "cinder-8d4485ed-2f2b-4078-97f0-6f38fa7150ab-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:25 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171" returned: 0 in 0.490s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:25 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689 1G Nov 02 10:53:25 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dade6d00-5304-4741-9607-cf95e1aa42cb tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "cinder-01c119f9-79cd-4466-b9f4-84129a9d08ce-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dade6d00-5304-4741-9607-cf95e1aa42cb tempest-CreateVolumesFromImageTest-1253718935 None] Lock "cinder-01c119f9-79cd-4466-b9f4-84129a9d08ce-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dade6d00-5304-4741-9607-cf95e1aa42cb tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "cinder-quobyte-01c119f9-79cd-4466-b9f4-84129a9d08ce" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dade6d00-5304-4741-9607-cf95e1aa42cb tempest-CreateVolumesFromImageTest-1253718935 None] Lock "cinder-quobyte-01c119f9-79cd-4466-b9f4-84129a9d08ce" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:25 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee813a64-2bd8-4a48-b941-50686102cfb3]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dade6d00-5304-4741-9607-cf95e1aa42cb tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-01c119f9-79cd-4466-b9f4-84129a9d08ce {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:25 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-01c119f9-79cd-4466-b9f4-84129a9d08ce Nov 02 10:53:25 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:25 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689 1G" returned: 0 in 0.561s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:25 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689 Nov 02 10:53:25 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:26 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dade6d00-5304-4741-9607-cf95e1aa42cb tempest-CreateVolumesFromImageTest-1253718935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-01c119f9-79cd-4466-b9f4-84129a9d08ce" returned: 0 in 0.485s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dade6d00-5304-4741-9607-cf95e1aa42cb tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-01c119f9-79cd-4466-b9f4-84129a9d08ce {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:26 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-01c119f9-79cd-4466-b9f4-84129a9d08ce Nov 02 10:53:26 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:26 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689" returned: 0 in 0.460s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:26 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689 is being set with open permissions: ugo+rw Nov 02 10:53:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:26 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689 Nov 02 10:53:26 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:26 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dade6d00-5304-4741-9607-cf95e1aa42cb tempest-CreateVolumesFromImageTest-1253718935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-01c119f9-79cd-4466-b9f4-84129a9d08ce" returned: 0 in 0.421s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dade6d00-5304-4741-9607-cf95e1aa42cb tempest-CreateVolumesFromImageTest-1253718935 None] Lock "cinder-quobyte-01c119f9-79cd-4466-b9f4-84129a9d08ce" released by "delete_volume" :: held 0.965s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:26 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689" returned: 0 in 0.315s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:26 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.info Nov 02 10:53:26 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:26 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-dade6d00-5304-4741-9607-cf95e1aa42cb tempest-CreateVolumesFromImageTest-1253718935 None] Created reservations ['24f88963-2532-4faa-b66a-63af15e2eeeb', '04cb9bd9-ca8e-42a0-9295-7e61fef54245', '2bb05bfe-11d4-448f-81fd-58e1518e8bad', '7a9eff67-0fcc-414e-8ea8-9b77db8e6deb'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dade6d00-5304-4741-9607-cf95e1aa42cb tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dade6d00-5304-4741-9607-cf95e1aa42cb tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-dade6d00-5304-4741-9607-cf95e1aa42cb tempest-CreateVolumesFromImageTest-1253718935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-dade6d00-5304-4741-9607-cf95e1aa42cb tempest-CreateVolumesFromImageTest-1253718935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dade6d00-5304-4741-9607-cf95e1aa42cb tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dade6d00-5304-4741-9607-cf95e1aa42cb tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:26 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:53:26 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:27 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.info" returned: 0 in 0.386s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:27 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.info is being set with open permissions: ugo+rw Nov 02 10:53:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:27 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.info Nov 02 10:53:27 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:27 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dade6d00-5304-4741-9607-cf95e1aa42cb tempest-CreateVolumesFromImageTest-1253718935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.364s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:27 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-dade6d00-5304-4741-9607-cf95e1aa42cb tempest-CreateVolumesFromImageTest-1253718935 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:27 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-dade6d00-5304-4741-9607-cf95e1aa42cb tempest-CreateVolumesFromImageTest-1253718935 None] Deleted volume successfully. Nov 02 10:53:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dade6d00-5304-4741-9607-cf95e1aa42cb tempest-CreateVolumesFromImageTest-1253718935 None] Lock "cinder-01c119f9-79cd-4466-b9f4-84129a9d08ce-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:27 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.info" returned: 0 in 0.275s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Acquiring lock "cinder-quobyte-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Lock "cinder-quobyte-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] snapshot: 76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689, volume: 38ff28eb-9ad8-4c5b-8bdb-db9d786ef455, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:53:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:27 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b9ce0b-b342-44fe-9bc4-6b558afc89e5]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:27 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689 Nov 02 10:53:27 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2abae968-0acb-4890-a5a3-99a8a88fd6d9 tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "cinder-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:28 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689" returned: 0 in 0.501s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:53:28 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[551a54c3-ea14-4821-b87b-6ff9d17940b3]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2abae968-0acb-4890-a5a3-99a8a88fd6d9 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "cinder-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2abae968-0acb-4890-a5a3-99a8a88fd6d9 tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "cinder-quobyte-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2abae968-0acb-4890-a5a3-99a8a88fd6d9 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "cinder-quobyte-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:28 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db77831-4d33-4871-9a41-2df027c7103c]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2abae968-0acb-4890-a5a3-99a8a88fd6d9 tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:28 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 Nov 02 10:53:28 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:28 devstack sudo[101227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad Nov 02 10:53:28 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:28 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171" returned: 0 in 0.573s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:53:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:53:28 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Path /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455 not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:53:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:28 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:28 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455 Nov 02 10:53:28 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2abae968-0acb-4890-a5a3-99a8a88fd6d9 tempest-CreateVolumesFromImageTest-1253718935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad" returned: 0 in 0.484s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2abae968-0acb-4890-a5a3-99a8a88fd6d9 tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:28 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad Nov 02 10:53:28 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:29 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2abae968-0acb-4890-a5a3-99a8a88fd6d9 tempest-CreateVolumesFromImageTest-1253718935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad" returned: 0 in 0.337s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2abae968-0acb-4890-a5a3-99a8a88fd6d9 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "cinder-quobyte-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad" released by "delete_volume" :: held 0.881s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:29 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-2abae968-0acb-4890-a5a3-99a8a88fd6d9 tempest-CreateVolumesFromImageTest-1253718935 None] Created reservations ['3be545d6-9a3a-4dce-aeaf-c79b4cddb5b8', 'e2ef607c-0dff-4226-bb66-1948b63c3ee6', '62033c05-4a28-46a4-b779-a381afa9bbbb', 'cd3ae4b3-e416-4869-a38a-aafc3ad0c58e'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2abae968-0acb-4890-a5a3-99a8a88fd6d9 tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2abae968-0acb-4890-a5a3-99a8a88fd6d9 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2abae968-0acb-4890-a5a3-99a8a88fd6d9 tempest-CreateVolumesFromImageTest-1253718935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2abae968-0acb-4890-a5a3-99a8a88fd6d9 tempest-CreateVolumesFromImageTest-1253718935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2abae968-0acb-4890-a5a3-99a8a88fd6d9 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2abae968-0acb-4890-a5a3-99a8a88fd6d9 tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:29 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:53:29 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a8643f45-a2d2-48f0-9fdc-bafa3a6f34c2 tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "cinder-bc367af2-f924-4f9e-a655-329b874b5585-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a8643f45-a2d2-48f0-9fdc-bafa3a6f34c2 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "cinder-bc367af2-f924-4f9e-a655-329b874b5585-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a8643f45-a2d2-48f0-9fdc-bafa3a6f34c2 tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "cinder-quobyte-bc367af2-f924-4f9e-a655-329b874b5585" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a8643f45-a2d2-48f0-9fdc-bafa3a6f34c2 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "cinder-quobyte-bc367af2-f924-4f9e-a655-329b874b5585" acquired by "delete_volume" :: waited 0.041s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:29 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d43b540-cd93-4563-a796-ade572c1b336]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8643f45-a2d2-48f0-9fdc-bafa3a6f34c2 tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc367af2-f924-4f9e-a655-329b874b5585 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:29 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2abae968-0acb-4890-a5a3-99a8a88fd6d9 tempest-CreateVolumesFromImageTest-1253718935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.674s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:29 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-2abae968-0acb-4890-a5a3-99a8a88fd6d9 tempest-CreateVolumesFromImageTest-1253718935 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2abae968-0acb-4890-a5a3-99a8a88fd6d9 tempest-CreateVolumesFromImageTest-1253718935 None] Deleted volume successfully. Nov 02 10:53:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2abae968-0acb-4890-a5a3-99a8a88fd6d9 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "cinder-a6f5ce0d-fd77-4aaa-87c4-90af2d08d8ad-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:30 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc367af2-f924-4f9e-a655-329b874b5585 Nov 02 10:53:30 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:30 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8643f45-a2d2-48f0-9fdc-bafa3a6f34c2 tempest-CreateVolumesFromImageTest-1253718935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc367af2-f924-4f9e-a655-329b874b5585" returned: 0 in 1.048s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8643f45-a2d2-48f0-9fdc-bafa3a6f34c2 tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc367af2-f924-4f9e-a655-329b874b5585 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:30 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc367af2-f924-4f9e-a655-329b874b5585 Nov 02 10:53:30 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:31 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8643f45-a2d2-48f0-9fdc-bafa3a6f34c2 tempest-CreateVolumesFromImageTest-1253718935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc367af2-f924-4f9e-a655-329b874b5585" returned: 0 in 0.731s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a8643f45-a2d2-48f0-9fdc-bafa3a6f34c2 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "cinder-quobyte-bc367af2-f924-4f9e-a655-329b874b5585" released by "delete_volume" :: held 1.931s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:31 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a8643f45-a2d2-48f0-9fdc-bafa3a6f34c2 tempest-CreateVolumesFromImageTest-1253718935 None] Created reservations ['3e338871-91be-4436-b9c1-56d76606ae66', 'b979af21-b1f9-4ee1-a02e-d7f1732eca17', '5588a628-ebee-4d75-b9df-19229498accc', '9e97eea1-1ddb-4b5e-966d-62b3025692e4'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a8643f45-a2d2-48f0-9fdc-bafa3a6f34c2 tempest-CreateVolumesFromImageTest-1253718935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a8643f45-a2d2-48f0-9fdc-bafa3a6f34c2 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a8643f45-a2d2-48f0-9fdc-bafa3a6f34c2 tempest-CreateVolumesFromImageTest-1253718935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a8643f45-a2d2-48f0-9fdc-bafa3a6f34c2 tempest-CreateVolumesFromImageTest-1253718935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a8643f45-a2d2-48f0-9fdc-bafa3a6f34c2 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8643f45-a2d2-48f0-9fdc-bafa3a6f34c2 tempest-CreateVolumesFromImageTest-1253718935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:32 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:53:32 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:32 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Flow 'volume_create_manager' (a77499cb-be57-4071-9abc-124ba6d1f8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4846002f-084f-49ce-949e-94a750eb1121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4846002f-084f-49ce-949e-94a750eb1121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfee76a0-b969-499e-b376-828f899e2cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d98873bba8e34e9eb2e5e688aa419e03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:32Z,use_quota=True,user_id='fd8516b1687c4c32b9cc3a044fc27cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37cd2ef1-83e5-44f1-889e-52159ba471c6),volume_type_id=37cd2ef1-83e5-44f1-889e-52159ba471c6)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b078acc-a21b-401a-bbca-ccb0d179bd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b078acc-a21b-401a-bbca-ccb0d179bd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f4160f-3a5b-41b9-83b1-363c60fab63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:32 devstack cinder-volume[87084]: DEBUG cinder.image.glance [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Creating Keystone auth plugin from conf {{(pid=87084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:53:32 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8643f45-a2d2-48f0-9fdc-bafa3a6f34c2 tempest-CreateVolumesFromImageTest-1253718935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.658s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:32 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-a8643f45-a2d2-48f0-9fdc-bafa3a6f34c2 tempest-CreateVolumesFromImageTest-1253718935 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:32 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a8643f45-a2d2-48f0-9fdc-bafa3a6f34c2 tempest-CreateVolumesFromImageTest-1253718935 None] Deleted volume successfully. Nov 02 10:53:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a8643f45-a2d2-48f0-9fdc-bafa3a6f34c2 tempest-CreateVolumesFromImageTest-1253718935 None] Lock "cinder-bc367af2-f924-4f9e-a655-329b874b5585-delete_volume" released by "delete_volume" :: held 3.208s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f4160f-3a5b-41b9-83b1-363c60fab63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dfee76a0-b969-499e-b376-828f899e2cca', 'volume_name': 'volume-dfee76a0-b969-499e-b376-828f899e2cca', 'volume_size': 1, 'image_id': 'e51592a3-6c83-47fe-ada3-2cf7f38d1e05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e51592a3-6c83-47fe-ada3-2cf7f38d1e05', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '75892748558d833107819c1c202e4be9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd98873bba8e34e9eb2e5e688aa419e03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '47c19231094b4934ec23e11da53a0f87fab5182a3f6d70b0b17619fe3fbfcfb8a85e7c6771b05f410928e0f05caac6c5aa6221d14c775be572daa139ef5849a7', 'id': 'e51592a3-6c83-47fe-ada3-2cf7f38d1e05', 'created_at': datetime.datetime(2026, 11, 2, 9, 53, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 53, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e51592a3-6c83-47fe-ada3-2cf7f38d1e05/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65a2c61-cfd0-470b-b544-54bf9b2c3f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65a2c61-cfd0-470b-b544-54bf9b2c3f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad0f052-77e5-4aa8-8c14-0d972816921a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:32 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Volume dfee76a0-b969-499e-b376-828f899e2cca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dfee76a0-b969-499e-b376-828f899e2cca', 'volume_size': 1, 'image_id': 'e51592a3-6c83-47fe-ada3-2cf7f38d1e05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e51592a3-6c83-47fe-ada3-2cf7f38d1e05', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '75892748558d833107819c1c202e4be9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd98873bba8e34e9eb2e5e688aa419e03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '47c19231094b4934ec23e11da53a0f87fab5182a3f6d70b0b17619fe3fbfcfb8a85e7c6771b05f410928e0f05caac6c5aa6221d14c775be572daa139ef5849a7', 'id': 'e51592a3-6c83-47fe-ada3-2cf7f38d1e05', 'created_at': datetime.datetime(2026, 11, 2, 9, 53, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 53, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e51592a3-6c83-47fe-ada3-2cf7f38d1e05/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 10:53:32 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Trying to clone dfee76a0-b969-499e-b376-828f899e2cca from image e51592a3-6c83-47fe-ada3-2cf7f38d1e05 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e51592a3-6c83-47fe-ada3-2cf7f38d1e05', 'metadata': {}}]). {{(pid=87084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:53:33 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:53:33 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Image download 0.00 MB at 0.00 MB/s Nov 02 10:53:33 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75766e1-3791-4d73-ad25-0bda6cbb5f6b]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:33 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD Nov 02 10:53:33 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:33 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD" returned: 0 in 0.813s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:34 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD Nov 02 10:53:34 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:34 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD" returned: 1 in 0.854s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:53:34 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Temporary image e51592a3-6c83-47fe-ada3-2cf7f38d1e05 is fetched for user fd8516b1687c4c32b9cc3a044fc27cbb. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:53:34 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e793a68-d5de-4713-afe7-21aadc5b322d]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:35 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD Nov 02 10:53:35 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:35 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD" returned: 0 in 0.503s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:35 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD Nov 02 10:53:35 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:36 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD" returned: 1 in 0.559s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:53:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:37 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455" returned: 0 in 8.996s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:37 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Image conversion details: src /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171, size 1024.00 MB, duration 9.00 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:53:37 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Converted 1024.00 MB image at 113.82 MB/s Nov 02 10:53:37 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455 is being set with open permissions: ugo+rw Nov 02 10:53:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:37 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455 Nov 02 10:53:37 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:37 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455" returned: 0 in 0.271s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Lock "cinder-quobyte-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455" released by "_copy_volume_from_snapshot" :: held 10.448s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Acquiring lock "cinder-quobyte-76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Lock "cinder-quobyte-76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Deleting offline snapshot 76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689 of volume 908c27ca-f2a3-4def-b1d3-376d4bdd9171 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:53:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] snapshot_file for this snap is: volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0516f34-cbc5-4db9-8b22-68c09652d649]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:38 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689 Nov 02 10:53:38 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=103,cinder:UPDATE=122,cinder:DELETE=9,cinder:INSERT=37 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=110,cinder:SELECT=102,cinder:INSERT=30,cinder:DELETE=11 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Flow 'volume_create_manager' (69de16e7-6242-4d59-b40c-2ce38829969f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71351706-433b-4bfa-9148-abb85a5cd89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71351706-433b-4bfa-9148-abb85a5cd89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1831314090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5ff7c8-71a9-460d-907f-9741bb6f0d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882e112a0a744ff293e8d169673cd290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:38Z,use_quota=True,user_id='6622b238e0284686b5d4f10c85d7ef82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab13c21e-bc00-4942-8293-acca36fa89b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab13c21e-bc00-4942-8293-acca36fa89b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:38 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6611094b-41e4-4b7a-9a81-456131aa9ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6611094b-41e4-4b7a-9a81-456131aa9ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e5ff7c8-71a9-460d-907f-9741bb6f0d58', 'volume_name': 'volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae39fd0-76d9-46a0-a4ec-112b3a4cdedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae39fd0-76d9-46a0-a4ec-112b3a4cdedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c118045-bd51-4da3-82a7-910e01e2f74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:38 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Volume 4e5ff7c8-71a9-460d-907f-9741bb6f0d58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58', 'volume_size': 1} Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689" returned: 0 in 0.388s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54528a3-07d8-4495-ab2d-e5365806807a]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:38 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 Nov 02 10:53:38 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:38 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171" returned: 0 in 0.535s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:38 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689 Nov 02 10:53:38 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:39 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689" returned: 0 in 0.356s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:39 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689 Nov 02 10:53:39 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:39 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171.76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689" returned: 0 in 0.232s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Lock "cinder-quobyte-76fa1cfb-78fd-4010-a6c9-0b3dcc3c0689" released by "_delete_snapshot" :: held 1.615s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.827s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.594s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfee76a0-b969-499e-b376-828f899e2cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d98873bba8e34e9eb2e5e688aa419e03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:32Z,use_quota=True,user_id='fd8516b1687c4c32b9cc3a044fc27cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37cd2ef1-83e5-44f1-889e-52159ba471c6),volume_type_id=37cd2ef1-83e5-44f1-889e-52159ba471c6)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:53:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Creating volume dfee76a0-b969-499e-b376-828f899e2cca {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:39 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:53:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dfee76a0-b969-499e-b376-828f899e2cca 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:39 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dfee76a0-b969-499e-b376-828f899e2cca 1073741824 Nov 02 10:53:39 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87a5b6f-0f5f-4357-9b10-b6faee363d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455', 'volume_size': 2, 'source_volid': '908c27ca-f2a3-4def-b1d3-376d4bdd9171', 'source_volstatus': 'available'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5861af-4382-4c83-84f8-1dede2f3b280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Volume volume-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455 (38ff28eb-9ad8-4c5b-8bdb-db9d786ef455): created successfully Nov 02 10:53:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5861af-4382-4c83-84f8-1dede2f3b280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Flow 'volume_create_manager' (f02399f9-aede-4ac6-ad3e-2c2b1bda15a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:39 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-72b7081a-1bc8-4787-a019-e0210671147c tempest-VolumesCloneTest-441576554 None] Created volume successfully. Nov 02 10:53:40 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dfee76a0-b969-499e-b376-828f899e2cca 1073741824" returned: 0 in 0.436s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dfee76a0-b969-499e-b376-828f899e2cca {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:40 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dfee76a0-b969-499e-b376-828f899e2cca Nov 02 10:53:40 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:40 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d1a64bd6-a61e-4bb1-b593-56b229b9eb44 tempest-VolumesCloneTest-441576554 None] Acquiring lock "cinder-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dfee76a0-b969-499e-b376-828f899e2cca" returned: 0 in 0.283s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.030s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1831314090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5ff7c8-71a9-460d-907f-9741bb6f0d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882e112a0a744ff293e8d169673cd290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:38Z,use_quota=True,user_id='6622b238e0284686b5d4f10c85d7ef82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Creating volume 4e5ff7c8-71a9-460d-907f-9741bb6f0d58 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:40 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:40 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58 1073741824 Nov 02 10:53:40 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d1a64bd6-a61e-4bb1-b593-56b229b9eb44 tempest-VolumesCloneTest-441576554 None] Lock "cinder-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Attempting download of e51592a3-6c83-47fe-ada3-2cf7f38d1e05 ((None, [{'url': 'file:///opt/stack/data/glance/images/e51592a3-6c83-47fe-ada3-2cf7f38d1e05', 'metadata': {}}])) to volume dfee76a0-b969-499e-b376-828f899e2cca. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d1a64bd6-a61e-4bb1-b593-56b229b9eb44 tempest-VolumesCloneTest-441576554 None] Acquiring lock "cinder-quobyte-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d1a64bd6-a61e-4bb1-b593-56b229b9eb44 tempest-VolumesCloneTest-441576554 None] Lock "cinder-quobyte-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33654cd-78e8-49d2-8b94-1f4e051d6764]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_6egis0om {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b432da-4f78-42a0-aa05-927cd03e5c62]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1a64bd6-a61e-4bb1-b593-56b229b9eb44 tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:40 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_6egis0om Nov 02 10:53:40 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:40 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455 Nov 02 10:53:40 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:40 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_6egis0om" returned: 0 in 0.408s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_6egis0om {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:40 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1a64bd6-a61e-4bb1-b593-56b229b9eb44 tempest-VolumesCloneTest-441576554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455" returned: 0 in 0.418s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1a64bd6-a61e-4bb1-b593-56b229b9eb44 tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:40 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58 1073741824" returned: 0 in 0.568s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:41 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455 Nov 02 10:53:41 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:41 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58 Nov 02 10:53:41 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:41 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_6egis0om Nov 02 10:53:41 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:41 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:41 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1a64bd6-a61e-4bb1-b593-56b229b9eb44 tempest-VolumesCloneTest-441576554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455" returned: 0 in 0.338s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58" returned: 0 in 0.276s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d1a64bd6-a61e-4bb1-b593-56b229b9eb44 tempest-VolumesCloneTest-441576554 None] Lock "cinder-quobyte-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455" released by "delete_volume" :: held 0.835s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c118045-bd51-4da3-82a7-910e01e2f74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75e790e-36c1-42c1-904f-4a1b8675e832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:41 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_6egis0om" returned: 1 in 0.440s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_6egis0om' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f241d055-4286-4ca4-93d3-05cffd97c230]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Volume volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58 (4e5ff7c8-71a9-460d-907f-9741bb6f0d58): created successfully Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75e790e-36c1-42c1-904f-4a1b8675e832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Flow 'volume_create_manager' (69de16e7-6242-4d59-b40c-2ce38829969f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1f1c4921-6a54-4003-9de7-e716a8aa429a tempest-CreateVolumesFromSnapshotTest-323353443 None] Created volume successfully. Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-d1a64bd6-a61e-4bb1-b593-56b229b9eb44 tempest-VolumesCloneTest-441576554 None] Created reservations ['9dc8262d-11a0-4b68-80c7-ad29546e0a1c', '88086ec8-6fc4-498e-a638-42bf8e1206ff', '756e429f-f743-4bdc-a177-f83192196c39', '113ca401-37d3-41aa-b9a1-5e26485e770b'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:41 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD Nov 02 10:53:41 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d1a64bd6-a61e-4bb1-b593-56b229b9eb44 tempest-VolumesCloneTest-441576554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d1a64bd6-a61e-4bb1-b593-56b229b9eb44 tempest-VolumesCloneTest-441576554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d1a64bd6-a61e-4bb1-b593-56b229b9eb44 tempest-VolumesCloneTest-441576554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d1a64bd6-a61e-4bb1-b593-56b229b9eb44 tempest-VolumesCloneTest-441576554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d1a64bd6-a61e-4bb1-b593-56b229b9eb44 tempest-VolumesCloneTest-441576554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1a64bd6-a61e-4bb1-b593-56b229b9eb44 tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:41 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:53:41 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:41 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:41 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1a64bd6-a61e-4bb1-b593-56b229b9eb44 tempest-VolumesCloneTest-441576554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.255s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-d1a64bd6-a61e-4bb1-b593-56b229b9eb44 tempest-VolumesCloneTest-441576554 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d1a64bd6-a61e-4bb1-b593-56b229b9eb44 tempest-VolumesCloneTest-441576554 None] Deleted volume successfully. Nov 02 10:53:41 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD Nov 02 10:53:41 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d1a64bd6-a61e-4bb1-b593-56b229b9eb44 tempest-VolumesCloneTest-441576554 None] Lock "cinder-38ff28eb-9ad8-4c5b-8bdb-db9d786ef455-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:42 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD" returned: 1 in 0.332s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:53:42 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] e51592a3-6c83-47fe-ada3-2cf7f38d1e05 was raw, converting to qcow2 {{(pid=87084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:53:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dfee76a0-b969-499e-b376-828f899e2cca {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:42 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dfee76a0-b969-499e-b376-828f899e2cca Nov 02 10:53:42 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:42 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dfee76a0-b969-499e-b376-828f899e2cca" returned: 0 in 0.527s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:42 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e51592a3-6c83-47fe-ada3-2cf7f38d1e05_fg02fcj5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dfee76a0-b969-499e-b376-828f899e2cca {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:53:42 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 10:53:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dfee76a0-b969-499e-b376-828f899e2cca 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:42 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dfee76a0-b969-499e-b376-828f899e2cca 1G Nov 02 10:53:42 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6da2949f-193d-4469-85b9-a313bf1802b9 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6da2949f-193d-4469-85b9-a313bf1802b9 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-571708eb-cae8-44c1-ae89-ff60a0a8df81 tempest-VolumesCloneTest-441576554 None] Acquiring lock "cinder-908c27ca-f2a3-4def-b1d3-376d4bdd9171-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6da2949f-193d-4469-85b9-a313bf1802b9 tempest-CreateVolumesFromSnapshotTest-323353443 None] Creating offline snapshot a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291 of volume 4e5ff7c8-71a9-460d-907f-9741bb6f0d58 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:53:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-571708eb-cae8-44c1-ae89-ff60a0a8df81 tempest-VolumesCloneTest-441576554 None] Lock "cinder-908c27ca-f2a3-4def-b1d3-376d4bdd9171-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:42 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e4bc67-7341-4c12-8261-db7c401a2c8f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6da2949f-193d-4469-85b9-a313bf1802b9 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-571708eb-cae8-44c1-ae89-ff60a0a8df81 tempest-VolumesCloneTest-441576554 None] Acquiring lock "cinder-quobyte-908c27ca-f2a3-4def-b1d3-376d4bdd9171" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-571708eb-cae8-44c1-ae89-ff60a0a8df81 tempest-VolumesCloneTest-441576554 None] Lock "cinder-quobyte-908c27ca-f2a3-4def-b1d3-376d4bdd9171" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:42 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1d86f5-198c-4e6a-badd-50eb96ef4a4c]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-571708eb-cae8-44c1-ae89-ff60a0a8df81 tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:42 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58 Nov 02 10:53:42 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:43 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dfee76a0-b969-499e-b376-828f899e2cca 1G" returned: 0 in 0.434s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Downloaded image e51592a3-6c83-47fe-ada3-2cf7f38d1e05 ((None, [{'url': 'file:///opt/stack/data/glance/images/e51592a3-6c83-47fe-ada3-2cf7f38d1e05', 'metadata': {}}])) to volume dfee76a0-b969-499e-b376-828f899e2cca successfully. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Temporary image e51592a3-6c83-47fe-ada3-2cf7f38d1e05 for user fd8516b1687c4c32b9cc3a044fc27cbb is deleted. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Marking volume dfee76a0-b969-499e-b376-828f899e2cca as bootable. {{(pid=87084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:53:43 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 Nov 02 10:53:43 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Copying metadata from image e51592a3-6c83-47fe-ada3-2cf7f38d1e05 to dfee76a0-b969-499e-b376-828f899e2cca. {{(pid=87084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Creating volume glance metadata for volume dfee76a0-b969-499e-b376-828f899e2cca backed by image e51592a3-6c83-47fe-ada3-2cf7f38d1e05 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e51592a3-6c83-47fe-ada3-2cf7f38d1e05', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '75892748558d833107819c1c202e4be9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad0f052-77e5-4aa8-8c14-0d972816921a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfee76a0-b969-499e-b376-828f899e2cca', 'volume_size': 1, 'image_id': 'e51592a3-6c83-47fe-ada3-2cf7f38d1e05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e51592a3-6c83-47fe-ada3-2cf7f38d1e05', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '75892748558d833107819c1c202e4be9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd98873bba8e34e9eb2e5e688aa419e03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '47c19231094b4934ec23e11da53a0f87fab5182a3f6d70b0b17619fe3fbfcfb8a85e7c6771b05f410928e0f05caac6c5aa6221d14c775be572daa139ef5849a7', 'id': 'e51592a3-6c83-47fe-ada3-2cf7f38d1e05', 'created_at': datetime.datetime(2026, 11, 2, 9, 53, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 53, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e51592a3-6c83-47fe-ada3-2cf7f38d1e05/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1510e0a-476e-44c1-88b7-7e6283bbdd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:43 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Volume volume-dfee76a0-b969-499e-b376-828f899e2cca (dfee76a0-b969-499e-b376-828f899e2cca): created successfully Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1510e0a-476e-44c1-88b7-7e6283bbdd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Flow 'volume_create_manager' (a77499cb-be57-4071-9abc-124ba6d1f8a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ceab6727-c311-444e-a1bb-a7192c2e3199 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Created volume successfully. Nov 02 10:53:43 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6da2949f-193d-4469-85b9-a313bf1802b9 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58" returned: 0 in 0.443s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6da2949f-193d-4469-85b9-a313bf1802b9 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:43 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291 1G Nov 02 10:53:43 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:43 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-571708eb-cae8-44c1-ae89-ff60a0a8df81 tempest-VolumesCloneTest-441576554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171" returned: 0 in 0.472s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-571708eb-cae8-44c1-ae89-ff60a0a8df81 tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:43 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171 Nov 02 10:53:43 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:43 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-571708eb-cae8-44c1-ae89-ff60a0a8df81 tempest-VolumesCloneTest-441576554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-908c27ca-f2a3-4def-b1d3-376d4bdd9171" returned: 0 in 0.282s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-571708eb-cae8-44c1-ae89-ff60a0a8df81 tempest-VolumesCloneTest-441576554 None] Lock "cinder-quobyte-908c27ca-f2a3-4def-b1d3-376d4bdd9171" released by "delete_volume" :: held 0.842s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:43 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6da2949f-193d-4469-85b9-a313bf1802b9 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291 1G" returned: 0 in 0.462s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6da2949f-193d-4469-85b9-a313bf1802b9 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:43 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291 Nov 02 10:53:43 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-571708eb-cae8-44c1-ae89-ff60a0a8df81 tempest-VolumesCloneTest-441576554 None] Created reservations ['d7cae914-abaa-4c8a-ab94-e9f2641995de', '5c23b90d-ce28-4594-a140-1238ae3af31b', '6a74e561-1dbb-4cb0-8d36-bbd8939f1542', '604751ed-2ee1-4090-81da-d19a6522bf5c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-571708eb-cae8-44c1-ae89-ff60a0a8df81 tempest-VolumesCloneTest-441576554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-571708eb-cae8-44c1-ae89-ff60a0a8df81 tempest-VolumesCloneTest-441576554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-571708eb-cae8-44c1-ae89-ff60a0a8df81 tempest-VolumesCloneTest-441576554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-571708eb-cae8-44c1-ae89-ff60a0a8df81 tempest-VolumesCloneTest-441576554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-571708eb-cae8-44c1-ae89-ff60a0a8df81 tempest-VolumesCloneTest-441576554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-571708eb-cae8-44c1-ae89-ff60a0a8df81 tempest-VolumesCloneTest-441576554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:43 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:53:43 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:44 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6da2949f-193d-4469-85b9-a313bf1802b9 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291" returned: 0 in 0.352s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:44 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-6da2949f-193d-4469-85b9-a313bf1802b9 tempest-CreateVolumesFromSnapshotTest-323353443 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291 is being set with open permissions: ugo+rw Nov 02 10:53:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6da2949f-193d-4469-85b9-a313bf1802b9 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:44 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291 Nov 02 10:53:44 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Acquiring lock "cinder-dfee76a0-b969-499e-b376-828f899e2cca-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Lock "cinder-dfee76a0-b969-499e-b376-828f899e2cca-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:44 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Acquiring lock "cinder-quobyte-dfee76a0-b969-499e-b376-828f899e2cca" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-571708eb-cae8-44c1-ae89-ff60a0a8df81 tempest-VolumesCloneTest-441576554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.367s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:44 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-571708eb-cae8-44c1-ae89-ff60a0a8df81 tempest-VolumesCloneTest-441576554 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-571708eb-cae8-44c1-ae89-ff60a0a8df81 tempest-VolumesCloneTest-441576554 None] Deleted volume successfully. Nov 02 10:53:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Lock "cinder-quobyte-dfee76a0-b969-499e-b376-828f899e2cca" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-571708eb-cae8-44c1-ae89-ff60a0a8df81 tempest-VolumesCloneTest-441576554 None] Lock "cinder-908c27ca-f2a3-4def-b1d3-376d4bdd9171-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:44 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0840401-6a07-4ae9-b9fe-f56455f651bf]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dfee76a0-b969-499e-b376-828f899e2cca {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:44 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6da2949f-193d-4469-85b9-a313bf1802b9 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291" returned: 0 in 0.339s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:44 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dfee76a0-b969-499e-b376-828f899e2cca Nov 02 10:53:44 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6da2949f-193d-4469-85b9-a313bf1802b9 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:44 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.info Nov 02 10:53:44 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:44 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dfee76a0-b969-499e-b376-828f899e2cca" returned: 0 in 0.396s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dfee76a0-b969-499e-b376-828f899e2cca {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:44 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dfee76a0-b969-499e-b376-828f899e2cca Nov 02 10:53:44 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:44 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6da2949f-193d-4469-85b9-a313bf1802b9 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.info" returned: 0 in 0.310s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:44 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-6da2949f-193d-4469-85b9-a313bf1802b9 tempest-CreateVolumesFromSnapshotTest-323353443 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.info is being set with open permissions: ugo+rw Nov 02 10:53:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6da2949f-193d-4469-85b9-a313bf1802b9 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:44 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.info Nov 02 10:53:44 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:45 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dfee76a0-b969-499e-b376-828f899e2cca" returned: 0 in 0.284s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Lock "cinder-quobyte-dfee76a0-b969-499e-b376-828f899e2cca" released by "delete_volume" :: held 0.759s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:45 devstack cinder-volume[87084]: WARNING cinder.quota [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:53:45 devstack cinder-volume[87084]: WARNING cinder.quota [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:53:45 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Created reservations ['82545fbb-17a1-4ab6-be23-132a61aea8f8', '36534887-395e-4dfe-b3ce-3df889dfbf45', 'a4547fc0-2deb-47f0-bc41-7b0f975bef70', '8e35c228-f79e-42aa-8359-56933088a332'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:45 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6da2949f-193d-4469-85b9-a313bf1802b9 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.info" returned: 0 in 0.388s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6da2949f-193d-4469-85b9-a313bf1802b9 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.430s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6da2949f-193d-4469-85b9-a313bf1802b9 tempest-CreateVolumesFromSnapshotTest-323353443 None] Create snapshot completed successfully Nov 02 10:53:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:45 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:53:45 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:45 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.378s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:45 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Deleted volume successfully. Nov 02 10:53:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7156c716-234b-4ded-bb5a-c0c816065916 tempest-VolumeAndVolumeTypeFromImageTest-1283363180 None] Lock "cinder-dfee76a0-b969-499e-b376-828f899e2cca-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Flow 'volume_create_manager' (1fe2b67d-c74e-4cc7-acfd-a82b650ab5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b85e3ba-8ad1-42f6-bec1-e1902b85075e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b85e3ba-8ad1-42f6-bec1-e1902b85075e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-101904199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f25a3698-79eb-49fd-af60-8f2f0bd637a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882e112a0a744ff293e8d169673cd290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:47Z,use_quota=True,user_id='6622b238e0284686b5d4f10c85d7ef82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbcf84b3-7d5c-4748-98e3-2fdb54246769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbcf84b3-7d5c-4748-98e3-2fdb54246769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac257f1-0323-476c-ba75-cb26177068e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac257f1-0323-476c-ba75-cb26177068e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f25a3698-79eb-49fd-af60-8f2f0bd637a5', 'volume_name': 'volume-f25a3698-79eb-49fd-af60-8f2f0bd637a5', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac74458f-71c5-43ab-9e83-7db596bc7ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac74458f-71c5-43ab-9e83-7db596bc7ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b56743e-f5f8-4381-a0d7-68c0ddb2602c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:46 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Volume f25a3698-79eb-49fd-af60-8f2f0bd637a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f25a3698-79eb-49fd-af60-8f2f0bd637a5', 'volume_size': 1} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-101904199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f25a3698-79eb-49fd-af60-8f2f0bd637a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882e112a0a744ff293e8d169673cd290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:47Z,use_quota=True,user_id='6622b238e0284686b5d4f10c85d7ef82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Creating volume f25a3698-79eb-49fd-af60-8f2f0bd637a5 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:46 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:53:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f25a3698-79eb-49fd-af60-8f2f0bd637a5 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:46 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f25a3698-79eb-49fd-af60-8f2f0bd637a5 1073741824 Nov 02 10:53:46 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:47 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Flow 'volume_create_manager' (c8f25d3d-78f5-4078-92df-fc8fba736314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd0d96c7-cb31-4afe-a93b-4f390c03e8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd0d96c7-cb31-4afe-a93b-4f390c03e8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-148476744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2105dfb4-7a49-4bed-96a7-4db97a866d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882e112a0a744ff293e8d169673cd290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:47Z,use_quota=True,user_id='6622b238e0284686b5d4f10c85d7ef82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb787df8-c866-45dc-b148-2e618f6f0b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb787df8-c866-45dc-b148-2e618f6f0b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e5c892a-0da1-44aa-8666-5e33b82bf6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e5c892a-0da1-44aa-8666-5e33b82bf6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2105dfb4-7a49-4bed-96a7-4db97a866d5c', 'volume_name': 'volume-2105dfb4-7a49-4bed-96a7-4db97a866d5c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ee4def-3f95-48e9-bd1b-cc1e815afaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ee4def-3f95-48e9-bd1b-cc1e815afaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c902d8-3dc7-49ec-a414-5f08829266ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:47 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Volume 2105dfb4-7a49-4bed-96a7-4db97a866d5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2105dfb4-7a49-4bed-96a7-4db97a866d5c', 'volume_size': 1} Nov 02 10:53:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:47 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f25a3698-79eb-49fd-af60-8f2f0bd637a5 1073741824" returned: 0 in 0.691s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f25a3698-79eb-49fd-af60-8f2f0bd637a5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:47 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f25a3698-79eb-49fd-af60-8f2f0bd637a5 Nov 02 10:53:47 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Flow 'volume_create_manager' (ae4f7eb6-0eac-4678-9616-a5d0221f3fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:48 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fce7557-254d-4f47-b034-fe83121eee16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f25a3698-79eb-49fd-af60-8f2f0bd637a5" returned: 0 in 0.503s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.777s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-148476744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2105dfb4-7a49-4bed-96a7-4db97a866d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882e112a0a744ff293e8d169673cd290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:47Z,use_quota=True,user_id='6622b238e0284686b5d4f10c85d7ef82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Creating volume 2105dfb4-7a49-4bed-96a7-4db97a866d5c {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:48 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2105dfb4-7a49-4bed-96a7-4db97a866d5c 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fce7557-254d-4f47-b034-fe83121eee16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-665675310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ac3958-fee1-403d-bcdb-6857854fb503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882e112a0a744ff293e8d169673cd290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:48Z,use_quota=True,user_id='6622b238e0284686b5d4f10c85d7ef82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6445b3c-c1bc-49a3-a988-192ea5db80c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6445b3c-c1bc-49a3-a988-192ea5db80c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:48 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2105dfb4-7a49-4bed-96a7-4db97a866d5c 1073741824 Nov 02 10:53:48 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7592f7cb-0656-49d1-8c58-5732db9ecb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7592f7cb-0656-49d1-8c58-5732db9ecb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65ac3958-fee1-403d-bcdb-6857854fb503', 'volume_name': 'volume-65ac3958-fee1-403d-bcdb-6857854fb503', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2119b1b6-8199-4e85-a612-65fc5b026279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2119b1b6-8199-4e85-a612-65fc5b026279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5022cae1-1b81-4647-8279-1f9cd7c5e847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:48 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Volume 65ac3958-fee1-403d-bcdb-6857854fb503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65ac3958-fee1-403d-bcdb-6857854fb503', 'volume_size': 1} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b56743e-f5f8-4381-a0d7-68c0ddb2602c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f25a3698-79eb-49fd-af60-8f2f0bd637a5', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67376269-ca6f-49fa-80fb-0253a857044c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:48 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Volume volume-f25a3698-79eb-49fd-af60-8f2f0bd637a5 (f25a3698-79eb-49fd-af60-8f2f0bd637a5): created successfully Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67376269-ca6f-49fa-80fb-0253a857044c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Flow 'volume_create_manager' (1fe2b67d-c74e-4cc7-acfd-a82b650ab5f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c328dc3e-84ce-446f-8b2b-b2f900a29ec7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Created volume successfully. Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Flow 'volume_create_manager' (1f0bd91b-a31b-473f-aa13-d7eac210edca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9225e138-9a96-434d-b654-5eab17890bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9225e138-9a96-434d-b654-5eab17890bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1319289010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=363d4b45-0a20-42f8-a325-5eb9f51dd9d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882e112a0a744ff293e8d169673cd290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:49Z,use_quota=True,user_id='6622b238e0284686b5d4f10c85d7ef82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:49 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0907ac1d-0950-42c8-a0d3-f97a2e4097c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0907ac1d-0950-42c8-a0d3-f97a2e4097c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6edc8727-e74b-4b15-8e87-3f5b4c92f07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6edc8727-e74b-4b15-8e87-3f5b4c92f07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '363d4b45-0a20-42f8-a325-5eb9f51dd9d8', 'volume_name': 'volume-363d4b45-0a20-42f8-a325-5eb9f51dd9d8', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8955bb8c-a6a5-4b03-99b2-0737983c33c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8955bb8c-a6a5-4b03-99b2-0737983c33c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af8f9b3-2730-4fe1-992f-b73b97a23ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:49 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Volume 363d4b45-0a20-42f8-a325-5eb9f51dd9d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-363d4b45-0a20-42f8-a325-5eb9f51dd9d8', 'volume_size': 1} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2105dfb4-7a49-4bed-96a7-4db97a866d5c 1073741824" returned: 0 in 0.879s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2105dfb4-7a49-4bed-96a7-4db97a866d5c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:49 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2105dfb4-7a49-4bed-96a7-4db97a866d5c Nov 02 10:53:49 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:49 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2105dfb4-7a49-4bed-96a7-4db97a866d5c" returned: 0 in 0.601s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.484s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-665675310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ac3958-fee1-403d-bcdb-6857854fb503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882e112a0a744ff293e8d169673cd290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:48Z,use_quota=True,user_id='6622b238e0284686b5d4f10c85d7ef82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Creating volume 65ac3958-fee1-403d-bcdb-6857854fb503 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:49 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-65ac3958-fee1-403d-bcdb-6857854fb503 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:49 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-65ac3958-fee1-403d-bcdb-6857854fb503 1073741824 Nov 02 10:53:49 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Flow 'volume_create_manager' (5d779bcd-5a42-4455-a141-1e466bed9719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a43487f2-c078-4a4e-aa5e-c7ff0d51b520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c902d8-3dc7-49ec-a414-5f08829266ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2105dfb4-7a49-4bed-96a7-4db97a866d5c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce723e11-7aac-4714-9676-9aafb6aecc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a43487f2-c078-4a4e-aa5e-c7ff0d51b520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-706265273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de9dea9-a484-4081-9e42-0d213e17a12c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882e112a0a744ff293e8d169673cd290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:50Z,use_quota=True,user_id='6622b238e0284686b5d4f10c85d7ef82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0092cf7-beda-4025-a40b-3e0e51c74222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0092cf7-beda-4025-a40b-3e0e51c74222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920d03a7-81a8-4ca9-96c6-b5d133c4a7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920d03a7-81a8-4ca9-96c6-b5d133c4a7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2de9dea9-a484-4081-9e42-0d213e17a12c', 'volume_name': 'volume-2de9dea9-a484-4081-9e42-0d213e17a12c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f107e3-6748-4d8a-8453-c9d978a56c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f107e3-6748-4d8a-8453-c9d978a56c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a857f1-6551-4e91-b4db-737a4ed99ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:49 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Volume 2de9dea9-a484-4081-9e42-0d213e17a12c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2de9dea9-a484-4081-9e42-0d213e17a12c', 'volume_size': 1} Nov 02 10:53:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:50 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Volume volume-2105dfb4-7a49-4bed-96a7-4db97a866d5c (2105dfb4-7a49-4bed-96a7-4db97a866d5c): created successfully Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce723e11-7aac-4714-9676-9aafb6aecc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Flow 'volume_create_manager' (c8f25d3d-78f5-4078-92df-fc8fba736314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:50 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-3a40156a-2fa1-4397-b32f-a39e899cbeea req-7fe1ca52-613a-4cf2-b99d-f4b32996af5c tempest-TestShelveInstance-1326132134 None] Terminate volume connection completed successfully. Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-3a40156a-2fa1-4397-b32f-a39e899cbeea req-7fe1ca52-613a-4cf2-b99d-f4b32996af5c tempest-TestShelveInstance-1326132134 None] Deleting attachment bb680748-edff-4f6d-b8d3-e8e5b6a57ea9. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:53:50 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7855c0d8-b35c-4932-bcd3-f25db3e48ad7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Created volume successfully. Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Flow 'volume_create_manager' (cc8dc0cd-e738-4fca-a5ed-5c576c138c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956bcb46-a40e-4147-bd6f-1aa1f580c97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956bcb46-a40e-4147-bd6f-1aa1f580c97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2053631599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e97127-e044-49c7-95a6-364e0aee666e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f0e63d7d134b25a85c2be311727e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:50Z,use_quota=True,user_id='3fd78d86ae6840d989330571515b35c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af296444-655c-4a96-87c4-d502fc7bf40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af296444-655c-4a96-87c4-d502fc7bf40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34306fc1-2aa4-4992-8f39-e57e8996d8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34306fc1-2aa4-4992-8f39-e57e8996d8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55e97127-e044-49c7-95a6-364e0aee666e', 'volume_name': 'volume-55e97127-e044-49c7-95a6-364e0aee666e', 'volume_size': 2}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e406583-6005-4c84-8b77-6c6a5c22eae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e406583-6005-4c84-8b77-6c6a5c22eae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f0c2d3-f605-44c9-be5f-a56571a7accf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:50 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Volume 55e97127-e044-49c7-95a6-364e0aee666e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55e97127-e044-49c7-95a6-364e0aee666e', 'volume_size': 2} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:50 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-65ac3958-fee1-403d-bcdb-6857854fb503 1073741824" returned: 0 in 0.637s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-65ac3958-fee1-403d-bcdb-6857854fb503 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:50 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-65ac3958-fee1-403d-bcdb-6857854fb503 Nov 02 10:53:50 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:50 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-65ac3958-fee1-403d-bcdb-6857854fb503" returned: 0 in 0.338s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.741s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1319289010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=363d4b45-0a20-42f8-a325-5eb9f51dd9d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882e112a0a744ff293e8d169673cd290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:49Z,use_quota=True,user_id='6622b238e0284686b5d4f10c85d7ef82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Creating volume 363d4b45-0a20-42f8-a325-5eb9f51dd9d8 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:50 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-363d4b45-0a20-42f8-a325-5eb9f51dd9d8 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5022cae1-1b81-4647-8279-1f9cd7c5e847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65ac3958-fee1-403d-bcdb-6857854fb503', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:50 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-363d4b45-0a20-42f8-a325-5eb9f51dd9d8 1073741824 Nov 02 10:53:50 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f44390b2-720e-4932-95fd-afd5f7acd3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:50 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Volume volume-65ac3958-fee1-403d-bcdb-6857854fb503 (65ac3958-fee1-403d-bcdb-6857854fb503): created successfully Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f44390b2-720e-4932-95fd-afd5f7acd3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Flow 'volume_create_manager' (ae4f7eb6-0eac-4678-9616-a5d0221f3fb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:50 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4294dfd6-53ba-4e6f-a694-ed01b3a09606 tempest-CreateVolumesFromSnapshotTest-323353443 None] Created volume successfully. Nov 02 10:53:51 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-363d4b45-0a20-42f8-a325-5eb9f51dd9d8 1073741824" returned: 0 in 0.595s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-363d4b45-0a20-42f8-a325-5eb9f51dd9d8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:51 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-363d4b45-0a20-42f8-a325-5eb9f51dd9d8 Nov 02 10:53:51 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:51 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-363d4b45-0a20-42f8-a325-5eb9f51dd9d8" returned: 0 in 0.308s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:53:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.829s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-706265273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de9dea9-a484-4081-9e42-0d213e17a12c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882e112a0a744ff293e8d169673cd290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:50Z,use_quota=True,user_id='6622b238e0284686b5d4f10c85d7ef82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:53:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Creating volume 2de9dea9-a484-4081-9e42-0d213e17a12c {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:51 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:53:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2de9dea9-a484-4081-9e42-0d213e17a12c 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:51 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2de9dea9-a484-4081-9e42-0d213e17a12c 1073741824 Nov 02 10:53:51 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af8f9b3-2730-4fe1-992f-b73b97a23ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-363d4b45-0a20-42f8-a325-5eb9f51dd9d8', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a26654-dad8-404b-9e79-24eb2e5b2fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:51 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Volume volume-363d4b45-0a20-42f8-a325-5eb9f51dd9d8 (363d4b45-0a20-42f8-a325-5eb9f51dd9d8): created successfully Nov 02 10:53:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a26654-dad8-404b-9e79-24eb2e5b2fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Flow 'volume_create_manager' (1f0bd91b-a31b-473f-aa13-d7eac210edca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:51 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-66df8404-3006-4f9e-a4f9-3d1520491d4e tempest-CreateVolumesFromSnapshotTest-323353443 None] Created volume successfully. Nov 02 10:53:52 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2de9dea9-a484-4081-9e42-0d213e17a12c 1073741824" returned: 0 in 0.553s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2de9dea9-a484-4081-9e42-0d213e17a12c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:52 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2de9dea9-a484-4081-9e42-0d213e17a12c Nov 02 10:53:52 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:52 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2de9dea9-a484-4081-9e42-0d213e17a12c" returned: 0 in 0.275s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:53:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.290s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2053631599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e97127-e044-49c7-95a6-364e0aee666e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f0e63d7d134b25a85c2be311727e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:50Z,use_quota=True,user_id='3fd78d86ae6840d989330571515b35c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:53:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Creating volume 55e97127-e044-49c7-95a6-364e0aee666e {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:52 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:53:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-55e97127-e044-49c7-95a6-364e0aee666e 2147483648 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:52 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-55e97127-e044-49c7-95a6-364e0aee666e 2147483648 Nov 02 10:53:52 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a857f1-6551-4e91-b4db-737a4ed99ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2de9dea9-a484-4081-9e42-0d213e17a12c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d814e01-4d8c-4173-959a-2b92ed409b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:52 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Volume volume-2de9dea9-a484-4081-9e42-0d213e17a12c (2de9dea9-a484-4081-9e42-0d213e17a12c): created successfully Nov 02 10:53:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d814e01-4d8c-4173-959a-2b92ed409b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Flow 'volume_create_manager' (5d779bcd-5a42-4455-a141-1e466bed9719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:52 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-28149075-1026-4c98-9de5-632923d4ba09 tempest-CreateVolumesFromSnapshotTest-323353443 None] Created volume successfully. Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:53 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:53:53 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7435f4ef-260b-49cc-b68f-0d74ad9651e3 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "cinder-2de9dea9-a484-4081-9e42-0d213e17a12c-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7435f4ef-260b-49cc-b68f-0d74ad9651e3 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-2de9dea9-a484-4081-9e42-0d213e17a12c-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7435f4ef-260b-49cc-b68f-0d74ad9651e3 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "cinder-quobyte-2de9dea9-a484-4081-9e42-0d213e17a12c" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:53 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-55e97127-e044-49c7-95a6-364e0aee666e 2147483648" returned: 0 in 0.827s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-7ca0b87b-1429-49ef-a78f-ed5af6d9cdba req-706fef5d-0580-4f3a-a1a8-362d4bbb65c4 tempest-TestShelveInstance-1326132134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:53 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.453s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7435f4ef-260b-49cc-b68f-0d74ad9651e3 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-quobyte-2de9dea9-a484-4081-9e42-0d213e17a12c" acquired by "delete_volume" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00cb411-f32c-40b7-bd4e-8b4a49afb4dc]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7435f4ef-260b-49cc-b68f-0d74ad9651e3 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2de9dea9-a484-4081-9e42-0d213e17a12c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Flow 'volume_create_manager' (48c5d0e0-c62a-4bc7-9101-fe7b28bca3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3253a1d3-722a-49b5-bdb3-4b21c583ef5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-55e97127-e044-49c7-95a6-364e0aee666e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:53 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-55e97127-e044-49c7-95a6-364e0aee666e Nov 02 10:53:53 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3253a1d3-722a-49b5-bdb3-4b21c583ef5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-122591143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1537b33-c612-4beb-89f5-1f17176fc9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c325bc3f87cf408bb10def7c1520d691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:54Z,use_quota=True,user_id='f5d5e910b0634eb0b3d679ed83f2fe30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71fc89d7-3067-4828-b791-79f36fdd34fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71fc89d7-3067-4828-b791-79f36fdd34fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:53 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2de9dea9-a484-4081-9e42-0d213e17a12c Nov 02 10:53:53 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a0e06c-c9bb-4501-b2f7-071c7cca6e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a0e06c-c9bb-4501-b2f7-071c7cca6e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1537b33-c612-4beb-89f5-1f17176fc9e4', 'volume_name': 'volume-d1537b33-c612-4beb-89f5-1f17176fc9e4', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec408b9e-d70c-4ae9-9995-4cd74e0f2fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec408b9e-d70c-4ae9-9995-4cd74e0f2fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658f338d-eb37-416e-9239-2e6ce4f723e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:53 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Volume d1537b33-c612-4beb-89f5-1f17176fc9e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1537b33-c612-4beb-89f5-1f17176fc9e4', 'volume_size': 1} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:53 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-55e97127-e044-49c7-95a6-364e0aee666e" returned: 0 in 0.265s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-7ca0b87b-1429-49ef-a78f-ed5af6d9cdba req-706fef5d-0580-4f3a-a1a8-362d4bbb65c4 tempest-TestShelveInstance-1326132134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.403s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f0c2d3-f605-44c9-be5f-a56571a7accf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55e97127-e044-49c7-95a6-364e0aee666e', 'volume_size': 2}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8385a0-a535-4fe6-ae91-6acbdf868fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-7ca0b87b-1429-49ef-a78f-ed5af6d9cdba req-706fef5d-0580-4f3a-a1a8-362d4bbb65c4 tempest-TestShelveInstance-1326132134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.225s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-122591143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1537b33-c612-4beb-89f5-1f17176fc9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c325bc3f87cf408bb10def7c1520d691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:54Z,use_quota=True,user_id='f5d5e910b0634eb0b3d679ed83f2fe30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Creating volume d1537b33-c612-4beb-89f5-1f17176fc9e4 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:53 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:53 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7435f4ef-260b-49cc-b68f-0d74ad9651e3 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2de9dea9-a484-4081-9e42-0d213e17a12c" returned: 0 in 0.398s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7435f4ef-260b-49cc-b68f-0d74ad9651e3 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2de9dea9-a484-4081-9e42-0d213e17a12c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:54 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 1073741824 Nov 02 10:53:54 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:54 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Volume volume-55e97127-e044-49c7-95a6-364e0aee666e (55e97127-e044-49c7-95a6-364e0aee666e): created successfully Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8385a0-a535-4fe6-ae91-6acbdf868fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:54 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2de9dea9-a484-4081-9e42-0d213e17a12c Nov 02 10:53:54 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Flow 'volume_create_manager' (cc8dc0cd-e738-4fca-a5ed-5c576c138c6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ea0612e1-6d22-444a-afa0-1d3e7c7d2d3a tempest-VolumesCloneNegativeTest-331865562 None] Created volume successfully. Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-7ca0b87b-1429-49ef-a78f-ed5af6d9cdba req-706fef5d-0580-4f3a-a1a8-362d4bbb65c4 tempest-TestShelveInstance-1326132134 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-6e163ee2-32e0-427d-b5b3-90347a892262', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b9f6134-2c8a-44a1-87a7-81f2b676f0cd', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:53:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-7ca0b87b-1429-49ef-a78f-ed5af6d9cdba req-706fef5d-0580-4f3a-a1a8-362d4bbb65c4 tempest-TestShelveInstance-1326132134 None] attachment_update completed successfully. Nov 02 10:53:54 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7435f4ef-260b-49cc-b68f-0d74ad9651e3 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2de9dea9-a484-4081-9e42-0d213e17a12c" returned: 0 in 0.276s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7435f4ef-260b-49cc-b68f-0d74ad9651e3 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-quobyte-2de9dea9-a484-4081-9e42-0d213e17a12c" released by "delete_volume" :: held 0.744s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-7435f4ef-260b-49cc-b68f-0d74ad9651e3 tempest-CreateVolumesFromSnapshotTest-323353443 None] Created reservations ['c1c8b665-7c1b-49e1-a557-7d80a33f3a9b', '76b33c23-9d39-411f-bb7a-9f2cc28c8f70', '335ef9ce-e9ca-4679-94a8-f5501f49577b', '2b6e2ec5-600d-44bb-81ce-f9f4b5009b18'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7435f4ef-260b-49cc-b68f-0d74ad9651e3 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7435f4ef-260b-49cc-b68f-0d74ad9651e3 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7435f4ef-260b-49cc-b68f-0d74ad9651e3 tempest-CreateVolumesFromSnapshotTest-323353443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7435f4ef-260b-49cc-b68f-0d74ad9651e3 tempest-CreateVolumesFromSnapshotTest-323353443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7435f4ef-260b-49cc-b68f-0d74ad9651e3 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7435f4ef-260b-49cc-b68f-0d74ad9651e3 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:54 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:53:54 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:54 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 1073741824" returned: 0 in 0.535s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:54 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 Nov 02 10:53:54 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4e1e8b38-2157-4cc6-b0f3-6aa87ace664c tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "cinder-363d4b45-0a20-42f8-a325-5eb9f51dd9d8-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4e1e8b38-2157-4cc6-b0f3-6aa87ace664c tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-363d4b45-0a20-42f8-a325-5eb9f51dd9d8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4e1e8b38-2157-4cc6-b0f3-6aa87ace664c tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "cinder-quobyte-363d4b45-0a20-42f8-a325-5eb9f51dd9d8" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4e1e8b38-2157-4cc6-b0f3-6aa87ace664c tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-quobyte-363d4b45-0a20-42f8-a325-5eb9f51dd9d8" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:54 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7435f4ef-260b-49cc-b68f-0d74ad9651e3 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.448s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-7435f4ef-260b-49cc-b68f-0d74ad9651e3 tempest-CreateVolumesFromSnapshotTest-323353443 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7435f4ef-260b-49cc-b68f-0d74ad9651e3 tempest-CreateVolumesFromSnapshotTest-323353443 None] Deleted volume successfully. Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be92488-c79c-4b77-b957-5d2e9f0bebca]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4e1e8b38-2157-4cc6-b0f3-6aa87ace664c tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-363d4b45-0a20-42f8-a325-5eb9f51dd9d8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7435f4ef-260b-49cc-b68f-0d74ad9651e3 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-2de9dea9-a484-4081-9e42-0d213e17a12c-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:55 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8a4f1f99-6ff5-48ca-90cb-807bc21d4ea7 tempest-VolumesCloneNegativeTest-331865562 None] Acquiring lock "cinder-55e97127-e044-49c7-95a6-364e0aee666e-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4" returned: 0 in 0.475s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658f338d-eb37-416e-9239-2e6ce4f723e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1537b33-c612-4beb-89f5-1f17176fc9e4', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:55 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-363d4b45-0a20-42f8-a325-5eb9f51dd9d8 Nov 02 10:53:55 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b56796-5955-443f-8338-087d60557879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8a4f1f99-6ff5-48ca-90cb-807bc21d4ea7 tempest-VolumesCloneNegativeTest-331865562 None] Lock "cinder-55e97127-e044-49c7-95a6-364e0aee666e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:55 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Volume volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 (d1537b33-c612-4beb-89f5-1f17176fc9e4): created successfully Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b56796-5955-443f-8338-087d60557879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Flow 'volume_create_manager' (48c5d0e0-c62a-4bc7-9101-fe7b28bca3e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:55 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0c93ec9d-6642-49e7-8ed9-19309031337d tempest-VolumeDependencyTests-848256554 None] Created volume successfully. Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8a4f1f99-6ff5-48ca-90cb-807bc21d4ea7 tempest-VolumesCloneNegativeTest-331865562 None] Acquiring lock "cinder-quobyte-55e97127-e044-49c7-95a6-364e0aee666e" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8a4f1f99-6ff5-48ca-90cb-807bc21d4ea7 tempest-VolumesCloneNegativeTest-331865562 None] Lock "cinder-quobyte-55e97127-e044-49c7-95a6-364e0aee666e" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2cd5e9-37d1-4364-9ad5-28a9b084512f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8a4f1f99-6ff5-48ca-90cb-807bc21d4ea7 tempest-VolumesCloneNegativeTest-331865562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-55e97127-e044-49c7-95a6-364e0aee666e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:55 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-55e97127-e044-49c7-95a6-364e0aee666e Nov 02 10:53:55 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:55 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4e1e8b38-2157-4cc6-b0f3-6aa87ace664c tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-363d4b45-0a20-42f8-a325-5eb9f51dd9d8" returned: 0 in 0.473s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4e1e8b38-2157-4cc6-b0f3-6aa87ace664c tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-363d4b45-0a20-42f8-a325-5eb9f51dd9d8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:55 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-363d4b45-0a20-42f8-a325-5eb9f51dd9d8 Nov 02 10:53:55 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:55 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8a4f1f99-6ff5-48ca-90cb-807bc21d4ea7 tempest-VolumesCloneNegativeTest-331865562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-55e97127-e044-49c7-95a6-364e0aee666e" returned: 0 in 0.427s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8a4f1f99-6ff5-48ca-90cb-807bc21d4ea7 tempest-VolumesCloneNegativeTest-331865562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-55e97127-e044-49c7-95a6-364e0aee666e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:55 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-55e97127-e044-49c7-95a6-364e0aee666e Nov 02 10:53:55 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:55 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4e1e8b38-2157-4cc6-b0f3-6aa87ace664c tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-363d4b45-0a20-42f8-a325-5eb9f51dd9d8" returned: 0 in 0.286s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4e1e8b38-2157-4cc6-b0f3-6aa87ace664c tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-quobyte-363d4b45-0a20-42f8-a325-5eb9f51dd9d8" released by "delete_volume" :: held 0.829s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-4e1e8b38-2157-4cc6-b0f3-6aa87ace664c tempest-CreateVolumesFromSnapshotTest-323353443 None] Created reservations ['4463eadd-e8ac-40a5-8dc3-27b6ca1dab5c', 'c6eca85e-dc44-4c19-a186-b5d4cd931561', 'ac19e7cf-40e6-4ead-844e-c64dbbd3dddd', '91d7bf89-d7c8-4ca3-96d1-e5ab72422a00'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:55 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8a4f1f99-6ff5-48ca-90cb-807bc21d4ea7 tempest-VolumesCloneNegativeTest-331865562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-55e97127-e044-49c7-95a6-364e0aee666e" returned: 0 in 0.337s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4e1e8b38-2157-4cc6-b0f3-6aa87ace664c tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4e1e8b38-2157-4cc6-b0f3-6aa87ace664c tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4e1e8b38-2157-4cc6-b0f3-6aa87ace664c tempest-CreateVolumesFromSnapshotTest-323353443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4e1e8b38-2157-4cc6-b0f3-6aa87ace664c tempest-CreateVolumesFromSnapshotTest-323353443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4e1e8b38-2157-4cc6-b0f3-6aa87ace664c tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4e1e8b38-2157-4cc6-b0f3-6aa87ace664c tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8a4f1f99-6ff5-48ca-90cb-807bc21d4ea7 tempest-VolumesCloneNegativeTest-331865562 None] Lock "cinder-quobyte-55e97127-e044-49c7-95a6-364e0aee666e" released by "delete_volume" :: held 0.859s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:56 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-506348c8-b6c8-401b-b96c-500dcb14e0e7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "cinder-65ac3958-fee1-403d-bcdb-6857854fb503-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:56 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-506348c8-b6c8-401b-b96c-500dcb14e0e7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-65ac3958-fee1-403d-bcdb-6857854fb503-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-506348c8-b6c8-401b-b96c-500dcb14e0e7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "cinder-quobyte-65ac3958-fee1-403d-bcdb-6857854fb503" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-506348c8-b6c8-401b-b96c-500dcb14e0e7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-quobyte-65ac3958-fee1-403d-bcdb-6857854fb503" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-8a4f1f99-6ff5-48ca-90cb-807bc21d4ea7 tempest-VolumesCloneNegativeTest-331865562 None] Created reservations ['629706d7-6a66-41fe-99c9-76245536b9b0', '89b90546-b5f7-4e03-8f57-dc8fca795301', '99965c56-a5b3-4f24-add3-380e0e43a55a', '8a281678-a115-4128-90d8-bab84a8d58c2'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e1c82a-67c7-4647-8274-8042f30035eb]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-506348c8-b6c8-401b-b96c-500dcb14e0e7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-65ac3958-fee1-403d-bcdb-6857854fb503 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-73955f52-7c9f-4d38-80af-bb71b31ae5af tempest-VolumeDependencyTests-848256554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-73955f52-7c9f-4d38-80af-bb71b31ae5af tempest-VolumeDependencyTests-848256554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-73955f52-7c9f-4d38-80af-bb71b31ae5af tempest-VolumeDependencyTests-848256554 None] Creating offline snapshot fdc9f2b6-bb51-4556-b0ff-5fbad89081cb of volume d1537b33-c612-4beb-89f5-1f17176fc9e4 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[78df7a6a-353d-4f69-ac01-fa0bdb40bca2]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-73955f52-7c9f-4d38-80af-bb71b31ae5af tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8a4f1f99-6ff5-48ca-90cb-807bc21d4ea7 tempest-VolumesCloneNegativeTest-331865562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8a4f1f99-6ff5-48ca-90cb-807bc21d4ea7 tempest-VolumesCloneNegativeTest-331865562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8a4f1f99-6ff5-48ca-90cb-807bc21d4ea7 tempest-VolumesCloneNegativeTest-331865562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8a4f1f99-6ff5-48ca-90cb-807bc21d4ea7 tempest-VolumesCloneNegativeTest-331865562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8a4f1f99-6ff5-48ca-90cb-807bc21d4ea7 tempest-VolumesCloneNegativeTest-331865562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8a4f1f99-6ff5-48ca-90cb-807bc21d4ea7 tempest-VolumesCloneNegativeTest-331865562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:56 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-65ac3958-fee1-403d-bcdb-6857854fb503 Nov 02 10:53:56 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:56 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:53:56 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:56 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4e1e8b38-2157-4cc6-b0f3-6aa87ace664c tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.464s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-4e1e8b38-2157-4cc6-b0f3-6aa87ace664c tempest-CreateVolumesFromSnapshotTest-323353443 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:56 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4e1e8b38-2157-4cc6-b0f3-6aa87ace664c tempest-CreateVolumesFromSnapshotTest-323353443 None] Deleted volume successfully. Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4e1e8b38-2157-4cc6-b0f3-6aa87ace664c tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-363d4b45-0a20-42f8-a325-5eb9f51dd9d8-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:56 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 Nov 02 10:53:56 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:56 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-506348c8-b6c8-401b-b96c-500dcb14e0e7 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-65ac3958-fee1-403d-bcdb-6857854fb503" returned: 0 in 0.516s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-506348c8-b6c8-401b-b96c-500dcb14e0e7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-65ac3958-fee1-403d-bcdb-6857854fb503 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:56 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-65ac3958-fee1-403d-bcdb-6857854fb503 Nov 02 10:53:56 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:56 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8a4f1f99-6ff5-48ca-90cb-807bc21d4ea7 tempest-VolumesCloneNegativeTest-331865562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.423s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-8a4f1f99-6ff5-48ca-90cb-807bc21d4ea7 tempest-VolumesCloneNegativeTest-331865562 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:56 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8a4f1f99-6ff5-48ca-90cb-807bc21d4ea7 tempest-VolumesCloneNegativeTest-331865562 None] Deleted volume successfully. Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8a4f1f99-6ff5-48ca-90cb-807bc21d4ea7 tempest-VolumesCloneNegativeTest-331865562 None] Lock "cinder-55e97127-e044-49c7-95a6-364e0aee666e-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:56 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-73955f52-7c9f-4d38-80af-bb71b31ae5af tempest-VolumeDependencyTests-848256554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4" returned: 0 in 0.536s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-73955f52-7c9f-4d38-80af-bb71b31ae5af tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:56 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb 1G Nov 02 10:53:56 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:57 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-506348c8-b6c8-401b-b96c-500dcb14e0e7 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-65ac3958-fee1-403d-bcdb-6857854fb503" returned: 0 in 0.296s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-506348c8-b6c8-401b-b96c-500dcb14e0e7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-quobyte-65ac3958-fee1-403d-bcdb-6857854fb503" released by "delete_volume" :: held 0.883s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:57 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-506348c8-b6c8-401b-b96c-500dcb14e0e7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Created reservations ['7a71debd-9e0a-4ea5-9a3f-1459918714b4', 'd7569113-ed80-48cd-90c9-a95e7815e166', '12b10ad9-9ab2-48d0-9fdd-1bbf7c653f82', 'a81df2c5-e20d-426f-9714-476f444fc420'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-506348c8-b6c8-401b-b96c-500dcb14e0e7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-506348c8-b6c8-401b-b96c-500dcb14e0e7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-506348c8-b6c8-401b-b96c-500dcb14e0e7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-506348c8-b6c8-401b-b96c-500dcb14e0e7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-506348c8-b6c8-401b-b96c-500dcb14e0e7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-506348c8-b6c8-401b-b96c-500dcb14e0e7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b7f970f3-8304-4e8d-9212-7c89efd80241 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "cinder-2105dfb4-7a49-4bed-96a7-4db97a866d5c-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:57 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:53:57 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b7f970f3-8304-4e8d-9212-7c89efd80241 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-2105dfb4-7a49-4bed-96a7-4db97a866d5c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b7f970f3-8304-4e8d-9212-7c89efd80241 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "cinder-quobyte-2105dfb4-7a49-4bed-96a7-4db97a866d5c" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b7f970f3-8304-4e8d-9212-7c89efd80241 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-quobyte-2105dfb4-7a49-4bed-96a7-4db97a866d5c" acquired by "delete_volume" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:57 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71bb4a0-8fd7-466d-9ef4-b8748781f8f3]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7f970f3-8304-4e8d-9212-7c89efd80241 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2105dfb4-7a49-4bed-96a7-4db97a866d5c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:57 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-73955f52-7c9f-4d38-80af-bb71b31ae5af tempest-VolumeDependencyTests-848256554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb 1G" returned: 0 in 0.710s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-73955f52-7c9f-4d38-80af-bb71b31ae5af tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:57 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb Nov 02 10:53:57 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:57 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2105dfb4-7a49-4bed-96a7-4db97a866d5c Nov 02 10:53:57 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:57 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-506348c8-b6c8-401b-b96c-500dcb14e0e7 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.555s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:57 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-506348c8-b6c8-401b-b96c-500dcb14e0e7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-506348c8-b6c8-401b-b96c-500dcb14e0e7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Deleted volume successfully. Nov 02 10:53:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-506348c8-b6c8-401b-b96c-500dcb14e0e7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-65ac3958-fee1-403d-bcdb-6857854fb503-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:58 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-73955f52-7c9f-4d38-80af-bb71b31ae5af tempest-VolumeDependencyTests-848256554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb" returned: 0 in 0.493s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:58 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-73955f52-7c9f-4d38-80af-bb71b31ae5af tempest-VolumeDependencyTests-848256554 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb is being set with open permissions: ugo+rw Nov 02 10:53:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-73955f52-7c9f-4d38-80af-bb71b31ae5af tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:58 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb Nov 02 10:53:58 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:58 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7f970f3-8304-4e8d-9212-7c89efd80241 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2105dfb4-7a49-4bed-96a7-4db97a866d5c" returned: 0 in 0.769s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7f970f3-8304-4e8d-9212-7c89efd80241 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2105dfb4-7a49-4bed-96a7-4db97a866d5c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:58 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2105dfb4-7a49-4bed-96a7-4db97a866d5c Nov 02 10:53:58 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:58 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-73955f52-7c9f-4d38-80af-bb71b31ae5af tempest-VolumeDependencyTests-848256554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb" returned: 0 in 0.357s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-73955f52-7c9f-4d38-80af-bb71b31ae5af tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:58 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.info Nov 02 10:53:58 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:58 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7f970f3-8304-4e8d-9212-7c89efd80241 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2105dfb4-7a49-4bed-96a7-4db97a866d5c" returned: 0 in 0.556s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b7f970f3-8304-4e8d-9212-7c89efd80241 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-quobyte-2105dfb4-7a49-4bed-96a7-4db97a866d5c" released by "delete_volume" :: held 1.439s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:59 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-b7f970f3-8304-4e8d-9212-7c89efd80241 tempest-CreateVolumesFromSnapshotTest-323353443 None] Created reservations ['8d6473e1-4825-40fe-af04-8fb27d41a633', 'e8421add-21cb-485b-a577-971e72aae40e', '796efad5-3de1-4d91-85f0-3abda1795c20', 'f9aa8f70-6d4d-4d71-9897-694486243b32'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:59 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-73955f52-7c9f-4d38-80af-bb71b31ae5af tempest-VolumeDependencyTests-848256554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.info" returned: 0 in 0.612s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:59 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-73955f52-7c9f-4d38-80af-bb71b31ae5af tempest-VolumeDependencyTests-848256554 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.info is being set with open permissions: ugo+rw Nov 02 10:53:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-73955f52-7c9f-4d38-80af-bb71b31ae5af tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:59 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.info Nov 02 10:53:59 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b7f970f3-8304-4e8d-9212-7c89efd80241 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b7f970f3-8304-4e8d-9212-7c89efd80241 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b7f970f3-8304-4e8d-9212-7c89efd80241 tempest-CreateVolumesFromSnapshotTest-323353443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b7f970f3-8304-4e8d-9212-7c89efd80241 tempest-CreateVolumesFromSnapshotTest-323353443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b7f970f3-8304-4e8d-9212-7c89efd80241 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7f970f3-8304-4e8d-9212-7c89efd80241 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:59 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:53:59 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:59 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-73955f52-7c9f-4d38-80af-bb71b31ae5af tempest-VolumeDependencyTests-848256554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.info" returned: 0 in 0.607s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:59 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-73955f52-7c9f-4d38-80af-bb71b31ae5af tempest-VolumeDependencyTests-848256554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.521s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3b3e7103-46fc-4510-8742-2d3969608d8e tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "cinder-f25a3698-79eb-49fd-af60-8f2f0bd637a5-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7f970f3-8304-4e8d-9212-7c89efd80241 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.492s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:59 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b7f970f3-8304-4e8d-9212-7c89efd80241 tempest-CreateVolumesFromSnapshotTest-323353443 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:59 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b7f970f3-8304-4e8d-9212-7c89efd80241 tempest-CreateVolumesFromSnapshotTest-323353443 None] Deleted volume successfully. Nov 02 10:53:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3b3e7103-46fc-4510-8742-2d3969608d8e tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-f25a3698-79eb-49fd-af60-8f2f0bd637a5-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b7f970f3-8304-4e8d-9212-7c89efd80241 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-2105dfb4-7a49-4bed-96a7-4db97a866d5c-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:59 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-73955f52-7c9f-4d38-80af-bb71b31ae5af tempest-VolumeDependencyTests-848256554 None] Create snapshot completed successfully Nov 02 10:54:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3b3e7103-46fc-4510-8742-2d3969608d8e tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "cinder-quobyte-f25a3698-79eb-49fd-af60-8f2f0bd637a5" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3b3e7103-46fc-4510-8742-2d3969608d8e tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-quobyte-f25a3698-79eb-49fd-af60-8f2f0bd637a5" acquired by "delete_volume" :: waited 0.036s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:00 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f5eeb2-33cd-4aaa-a945-2871e3018d01]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3b3e7103-46fc-4510-8742-2d3969608d8e tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f25a3698-79eb-49fd-af60-8f2f0bd637a5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:00 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f25a3698-79eb-49fd-af60-8f2f0bd637a5 Nov 02 10:54:00 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:00 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3b3e7103-46fc-4510-8742-2d3969608d8e tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f25a3698-79eb-49fd-af60-8f2f0bd637a5" returned: 0 in 0.551s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3b3e7103-46fc-4510-8742-2d3969608d8e tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f25a3698-79eb-49fd-af60-8f2f0bd637a5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:00 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f25a3698-79eb-49fd-af60-8f2f0bd637a5 Nov 02 10:54:00 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:01 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3b3e7103-46fc-4510-8742-2d3969608d8e tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f25a3698-79eb-49fd-af60-8f2f0bd637a5" returned: 0 in 0.427s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3b3e7103-46fc-4510-8742-2d3969608d8e tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-quobyte-f25a3698-79eb-49fd-af60-8f2f0bd637a5" released by "delete_volume" :: held 1.116s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-3b3e7103-46fc-4510-8742-2d3969608d8e tempest-CreateVolumesFromSnapshotTest-323353443 None] Created reservations ['516e6ba5-ad71-47f1-880c-bc9525c90c3f', '72982eca-14d6-4423-880f-a6df0dbe0ae1', 'e4d1c255-c191-4d63-a426-52837a8e4260', '101dd116-2761-4571-9029-e8ff4f69c76b'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Flow 'volume_create_manager' (88faf9a1-f7e6-433c-91db-763af044b6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f938f49e-48c8-4246-a713-add4c6f5eee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f938f49e-48c8-4246-a713-add4c6f5eee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-635481517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a54f2dc-5f95-4414-8196-631387b10db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c325bc3f87cf408bb10def7c1520d691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fdc9f2b6-bb51-4556-b0ff-5fbad89081cb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:01Z,use_quota=True,user_id='f5d5e910b0634eb0b3d679ed83f2fe30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6285ff3-fcb4-4718-8440-9ce489433efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6285ff3-fcb4-4718-8440-9ce489433efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb8c6eb-2e33-4573-bbc4-6cde9d093d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb8c6eb-2e33-4573-bbc4-6cde9d093d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7a54f2dc-5f95-4414-8196-631387b10db4', 'volume_name': 'volume-7a54f2dc-5f95-4414-8196-631387b10db4', 'volume_size': 1, 'snapshot_id': 'fdc9f2b6-bb51-4556-b0ff-5fbad89081cb'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a752553-afe7-4483-9d5a-7b0c631b0098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a752553-afe7-4483-9d5a-7b0c631b0098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f858e6-1e75-4748-9a72-f8b1ad495649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:01 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Volume 7a54f2dc-5f95-4414-8196-631387b10db4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7a54f2dc-5f95-4414-8196-631387b10db4', 'volume_size': 1, 'snapshot_id': 'fdc9f2b6-bb51-4556-b0ff-5fbad89081cb'} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3b3e7103-46fc-4510-8742-2d3969608d8e tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3b3e7103-46fc-4510-8742-2d3969608d8e tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3b3e7103-46fc-4510-8742-2d3969608d8e tempest-CreateVolumesFromSnapshotTest-323353443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3b3e7103-46fc-4510-8742-2d3969608d8e tempest-CreateVolumesFromSnapshotTest-323353443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3b3e7103-46fc-4510-8742-2d3969608d8e tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3b3e7103-46fc-4510-8742-2d3969608d8e tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Acquiring lock "cinder-quobyte-fdc9f2b6-bb51-4556-b0ff-5fbad89081cb-7a54f2dc-5f95-4414-8196-631387b10db4" by "_create_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Lock "cinder-quobyte-fdc9f2b6-bb51-4556-b0ff-5fbad89081cb-7a54f2dc-5f95-4414-8196-631387b10db4" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Creating volume 7a54f2dc-5f95-4414-8196-631387b10db4 from snapshot fdc9f2b6-bb51-4556-b0ff-5fbad89081cb {{(pid=87084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:01 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:54:01 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Acquiring lock "cinder-quobyte-7a54f2dc-5f95-4414-8196-631387b10db4" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Lock "cinder-quobyte-7a54f2dc-5f95-4414-8196-631387b10db4" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] snapshot: fdc9f2b6-bb51-4556-b0ff-5fbad89081cb, volume: 7a54f2dc-5f95-4414-8196-631387b10db4, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a76b0a2-0476-4ece-834b-c4f326637664]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:01 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb Nov 02 10:54:01 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:01 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3b3e7103-46fc-4510-8742-2d3969608d8e tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.383s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-3b3e7103-46fc-4510-8742-2d3969608d8e tempest-CreateVolumesFromSnapshotTest-323353443 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:01 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3b3e7103-46fc-4510-8742-2d3969608d8e tempest-CreateVolumesFromSnapshotTest-323353443 None] Deleted volume successfully. Nov 02 10:54:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3b3e7103-46fc-4510-8742-2d3969608d8e tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-f25a3698-79eb-49fd-af60-8f2f0bd637a5-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "cinder-a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "cinder-quobyte-4e5ff7c8-71a9-460d-907f-9741bb6f0d58" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-quobyte-4e5ff7c8-71a9-460d-907f-9741bb6f0d58" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "cinder-quobyte-a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:02 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb" returned: 0 in 0.585s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1537b33-c612-4beb-89f5-1f17176fc9e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:54:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-quobyte-a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Deleting offline snapshot a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291 of volume 4e5ff7c8-71a9-460d-907f-9741bb6f0d58 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:54:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] snapshot_file for this snap is: volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:54:02 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[955f40a3-88db-4ab7-a4f3-f9999b378225]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:02 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9210a40-7203-4561-89a0-9f102a14f714]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:02 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 Nov 02 10:54:02 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:02 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291 Nov 02 10:54:02 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:02 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4" returned: 0 in 0.596s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:54:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:54:02 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Path /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7a54f2dc-5f95-4414-8196-631387b10db4 not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:54:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7a54f2dc-5f95-4414-8196-631387b10db4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:03 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7a54f2dc-5f95-4414-8196-631387b10db4 Nov 02 10:54:03 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:03 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291" returned: 0 in 0.729s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:54:03 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc5002e-70c0-4482-98af-34f72ea235b4]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:03 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58 Nov 02 10:54:03 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:03 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58" returned: 0 in 0.690s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:03 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291 Nov 02 10:54:03 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:05 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291" returned: 0 in 1.278s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:05 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291 Nov 02 10:54:05 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:05 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58.a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291" returned: 0 in 0.798s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:05 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Flow 'volume_create_manager' (73bcad31-ec1e-4519-b03e-f064b791664c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f06fb4f-9612-43ca-b502-7e40aad7720b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f06fb4f-9612-43ca-b502-7e40aad7720b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-13809258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3370878-4f4e-43e8-b1ff-b706f8c1f710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e73a3a9373b640658127b9401bfc8d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:06Z,use_quota=True,user_id='b2bdd2ee81fd43ba84497b7640d7319a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a27d05-09b7-4ac5-8a37-431bd6a03131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a27d05-09b7-4ac5-8a37-431bd6a03131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9527cfbf-b891-4e28-bb52-34d8cf8deed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:06 devstack cinder-volume[87084]: DEBUG cinder.image.glance [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Creating Keystone auth plugin from conf {{(pid=87084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:54:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-quobyte-a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291" released by "_delete_snapshot" :: held 3.860s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-quobyte-4e5ff7c8-71a9-460d-907f-9741bb6f0d58" released by "delete_snapshot" :: held 3.917s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:06 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Created reservations ['62f71dc4-f189-4ac5-b575-62cec040faf7', '01fe88be-60fb-4830-be90-aae57b529325', 'c5fcbbd4-97f6-4fdb-8f6f-ab8d22908912', 'a04ef0b2-2033-4124-b988-2de86925b5e8'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:06 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Delete snapshot completed successfully. Nov 02 10:54:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-84dcb3a9-1ead-42ef-94e6-e504311ebab7 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-a6acdbe4-b8fa-4b8c-8242-f8f6e85f3291-delete_snapshot" released by "delete_snapshot" :: held 4.408s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9527cfbf-b891-4e28-bb52-34d8cf8deed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a3370878-4f4e-43e8-b1ff-b706f8c1f710', 'volume_name': 'volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710', 'volume_size': 1, 'image_id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9af457eb3c6844a99ee880354ae43eac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'created_at': datetime.datetime(2026, 11, 2, 9, 33, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0223-61d3-44de-a27f-c6e0b6ba1310/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120a2498-1f15-436e-b397-ca4d500649e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120a2498-1f15-436e-b397-ca4d500649e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463ff776-0a85-402f-99af-fa85d0655e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:07 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Volume a3370878-4f4e-43e8-b1ff-b706f8c1f710: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710', 'volume_size': 1, 'image_id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9af457eb3c6844a99ee880354ae43eac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'created_at': datetime.datetime(2026, 11, 2, 9, 33, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0223-61d3-44de-a27f-c6e0b6ba1310/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:54:07 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Trying to clone a3370878-4f4e-43e8-b1ff-b706f8c1f710 from image 918d0223-61d3-44de-a27f-c6e0b6ba1310 at location (None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}]). {{(pid=87084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:54:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5b61853a-9995-4878-9110-94a12e3ea034 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "cinder-4e5ff7c8-71a9-460d-907f-9741bb6f0d58-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5b61853a-9995-4878-9110-94a12e3ea034 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-4e5ff7c8-71a9-460d-907f-9741bb6f0d58-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5b61853a-9995-4878-9110-94a12e3ea034 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "cinder-quobyte-4e5ff7c8-71a9-460d-907f-9741bb6f0d58" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5b61853a-9995-4878-9110-94a12e3ea034 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-quobyte-4e5ff7c8-71a9-460d-907f-9741bb6f0d58" acquired by "delete_volume" :: waited 0.059s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:07 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6aa737-ae74-4da3-8bf6-c73e2d47963b]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5b61853a-9995-4878-9110-94a12e3ea034 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:08 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58 Nov 02 10:54:08 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:08 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_d87uoom3devstack@QuobyteHD, size 20.69 MB, duration 1.07 sec {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:54:08 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Image download 20.69 MB at 19.42 MB/s Nov 02 10:54:08 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b4414a-5d15-481b-b48a-7587c4832275]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_d87uoom3devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:08 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_d87uoom3devstack@QuobyteHD Nov 02 10:54:08 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:09 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5b61853a-9995-4878-9110-94a12e3ea034 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58" returned: 0 in 1.484s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5b61853a-9995-4878-9110-94a12e3ea034 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:09 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58 Nov 02 10:54:09 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:09 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_d87uoom3devstack@QuobyteHD" returned: 0 in 0.965s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:09 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Temporary image 918d0223-61d3-44de-a27f-c6e0b6ba1310 is fetched for user b2bdd2ee81fd43ba84497b7640d7319a. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:54:09 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[edebe18e-4793-4186-96c4-55ec3a48fb68]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_d87uoom3devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:09 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_d87uoom3devstack@QuobyteHD Nov 02 10:54:09 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:09 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5b61853a-9995-4878-9110-94a12e3ea034 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5ff7c8-71a9-460d-907f-9741bb6f0d58" returned: 0 in 0.685s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5b61853a-9995-4878-9110-94a12e3ea034 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-quobyte-4e5ff7c8-71a9-460d-907f-9741bb6f0d58" released by "delete_volume" :: held 2.367s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:09 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-5b61853a-9995-4878-9110-94a12e3ea034 tempest-CreateVolumesFromSnapshotTest-323353443 None] Created reservations ['dc0989be-de65-4f29-84f1-a68f920f5b8a', 'af213268-abb3-4933-8002-fa6edeabc0ea', 'd4b9aa3f-1696-41d7-ad58-5312ed28196f', '3b1803d5-12d5-46db-9f18-9459c3f92a29'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5b61853a-9995-4878-9110-94a12e3ea034 tempest-CreateVolumesFromSnapshotTest-323353443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5b61853a-9995-4878-9110-94a12e3ea034 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5b61853a-9995-4878-9110-94a12e3ea034 tempest-CreateVolumesFromSnapshotTest-323353443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5b61853a-9995-4878-9110-94a12e3ea034 tempest-CreateVolumesFromSnapshotTest-323353443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5b61853a-9995-4878-9110-94a12e3ea034 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5b61853a-9995-4878-9110-94a12e3ea034 tempest-CreateVolumesFromSnapshotTest-323353443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:10 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_d87uoom3devstack@QuobyteHD" returned: 0 in 0.828s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:10 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:54:10 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:10 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5b61853a-9995-4878-9110-94a12e3ea034 tempest-CreateVolumesFromSnapshotTest-323353443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.565s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:10 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-5b61853a-9995-4878-9110-94a12e3ea034 tempest-CreateVolumesFromSnapshotTest-323353443 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:10 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5b61853a-9995-4878-9110-94a12e3ea034 tempest-CreateVolumesFromSnapshotTest-323353443 None] Deleted volume successfully. Nov 02 10:54:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5b61853a-9995-4878-9110-94a12e3ea034 tempest-CreateVolumesFromSnapshotTest-323353443 None] Lock "cinder-4e5ff7c8-71a9-460d-907f-9741bb6f0d58-delete_volume" released by "delete_volume" :: held 3.659s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:12 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7a54f2dc-5f95-4414-8196-631387b10db4" returned: 0 in 9.398s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Image conversion details: src /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4, size 1024.00 MB, duration 9.40 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7a54f2dc-5f95-4414-8196-631387b10db4 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:54:12 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Converted 1024.00 MB image at 108.95 MB/s Nov 02 10:54:12 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7a54f2dc-5f95-4414-8196-631387b10db4 is being set with open permissions: ugo+rw Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7a54f2dc-5f95-4414-8196-631387b10db4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:12 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7a54f2dc-5f95-4414-8196-631387b10db4 Nov 02 10:54:12 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:12 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7a54f2dc-5f95-4414-8196-631387b10db4" returned: 0 in 0.283s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Lock "cinder-quobyte-7a54f2dc-5f95-4414-8196-631387b10db4" released by "_copy_volume_from_snapshot" :: held 11.047s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Lock "cinder-quobyte-fdc9f2b6-bb51-4556-b0ff-5fbad89081cb-7a54f2dc-5f95-4414-8196-631387b10db4" released by "_create_volume_from_snapshot" :: held 11.117s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.140s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.425s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-13809258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3370878-4f4e-43e8-b1ff-b706f8c1f710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e73a3a9373b640658127b9401bfc8d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:06Z,use_quota=True,user_id='b2bdd2ee81fd43ba84497b7640d7319a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Creating volume a3370878-4f4e-43e8-b1ff-b706f8c1f710 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:12 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:12 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710 1073741824 Nov 02 10:54:12 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f858e6-1e75-4748-9a72-f8b1ad495649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a54f2dc-5f95-4414-8196-631387b10db4', 'volume_size': 1, 'snapshot_id': 'fdc9f2b6-bb51-4556-b0ff-5fbad89081cb'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a7907ff-e521-48b1-97fe-c9b4532ca7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:12 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Volume volume-7a54f2dc-5f95-4414-8196-631387b10db4 (7a54f2dc-5f95-4414-8196-631387b10db4): created successfully Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a7907ff-e521-48b1-97fe-c9b4532ca7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Flow 'volume_create_manager' (88faf9a1-f7e6-433c-91db-763af044b6dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:12 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-06b03021-9454-47e6-8da9-a677cf3d6260 tempest-VolumeDependencyTests-848256554 None] Created volume successfully. Nov 02 10:54:13 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710 1073741824" returned: 0 in 0.485s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:13 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710 Nov 02 10:54:13 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:13 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710" returned: 0 in 0.264s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:13 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Attempting download of 918d0223-61d3-44de-a27f-c6e0b6ba1310 ((None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}])) to volume a3370878-4f4e-43e8-b1ff-b706f8c1f710. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:54:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a610c5e-1756-4736-90a8-a172f2edb18d]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310__0nc9agy {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:13 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310__0nc9agy Nov 02 10:54:13 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] Acquiring lock "cinder-fdc9f2b6-bb51-4556-b0ff-5fbad89081cb-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] Lock "cinder-fdc9f2b6-bb51-4556-b0ff-5fbad89081cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] Acquiring lock "cinder-quobyte-d1537b33-c612-4beb-89f5-1f17176fc9e4" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] Lock "cinder-quobyte-d1537b33-c612-4beb-89f5-1f17176fc9e4" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] Acquiring lock "cinder-quobyte-fdc9f2b6-bb51-4556-b0ff-5fbad89081cb" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] Lock "cinder-quobyte-fdc9f2b6-bb51-4556-b0ff-5fbad89081cb" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] Deleting offline snapshot fdc9f2b6-bb51-4556-b0ff-5fbad89081cb of volume d1537b33-c612-4beb-89f5-1f17176fc9e4 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:54:14 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] snapshot_file for this snap is: volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:54:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310__0nc9agy" returned: 0 in 0.451s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310__0nc9agy {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c081329-581b-4df9-ab30-df0e92f4d5d6]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:14 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310__0nc9agy Nov 02 10:54:14 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:14 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb Nov 02 10:54:14 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:14 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310__0nc9agy" returned: 1 in 0.409s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_918d0223-61d3-44de-a27f-c6e0b6ba1310__0nc9agy' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:54:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4522eef-ae6c-4586-a456-22b96977377d]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_d87uoom3devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:14 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb" returned: 0 in 0.513s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1537b33-c612-4beb-89f5-1f17176fc9e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:54:14 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_d87uoom3devstack@QuobyteHD Nov 02 10:54:14 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5f7757-c826-452b-8763-ec97395432f4]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:14 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 Nov 02 10:54:14 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:14 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_d87uoom3devstack@QuobyteHD" returned: 0 in 0.443s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:14 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] 918d0223-61d3-44de-a27f-c6e0b6ba1310 was qcow2, converting to qcow2 {{(pid=87084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:54:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_d87uoom3devstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:14 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_d87uoom3devstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710 Nov 02 10:54:14 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:15 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Flow 'volume_create_manager' (87b737d3-a5c8-4c41-8d8d-725e57ffd5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe507f5e-a18f-4b4d-9d2b-9e2d3374285b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4" returned: 0 in 0.685s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:15 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb Nov 02 10:54:15 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe507f5e-a18f-4b4d-9d2b-9e2d3374285b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50af7e1-4e3b-443c-8fe7-f89c13d57c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7dac9ec2e0472693ed8031dc553c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:15Z,use_quota=True,user_id='b9856c12dc3a4f0a87ee771dc5c6eb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee6a339-1836-44de-88d6-4a403baba75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee6a339-1836-44de-88d6-4a403baba75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (828dd06d-1564-4cd4-9469-53b368e0154b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (828dd06d-1564-4cd4-9469-53b368e0154b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f50af7e1-4e3b-443c-8fe7-f89c13d57c79', 'volume_name': 'volume-f50af7e1-4e3b-443c-8fe7-f89c13d57c79', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e648695b-930a-4c24-80f0-f93daf4d8742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e648695b-930a-4c24-80f0-f93daf4d8742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe0e162-647c-4ab9-ad33-3dcda79c7ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:15 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Volume f50af7e1-4e3b-443c-8fe7-f89c13d57c79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f50af7e1-4e3b-443c-8fe7-f89c13d57c79', 'volume_size': 1} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50af7e1-4e3b-443c-8fe7-f89c13d57c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7dac9ec2e0472693ed8031dc553c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:15Z,use_quota=True,user_id='b9856c12dc3a4f0a87ee771dc5c6eb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Creating volume f50af7e1-4e3b-443c-8fe7-f89c13d57c79 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:15 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f50af7e1-4e3b-443c-8fe7-f89c13d57c79 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:15 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f50af7e1-4e3b-443c-8fe7-f89c13d57c79 1073741824 Nov 02 10:54:15 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:15 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb" returned: 0 in 0.386s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:15 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb Nov 02 10:54:15 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:16 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f50af7e1-4e3b-443c-8fe7-f89c13d57c79 1073741824" returned: 0 in 0.623s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:16 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4.fdc9f2b6-bb51-4556-b0ff-5fbad89081cb" returned: 0 in 0.368s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f50af7e1-4e3b-443c-8fe7-f89c13d57c79 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] Lock "cinder-quobyte-fdc9f2b6-bb51-4556-b0ff-5fbad89081cb" released by "_delete_snapshot" :: held 2.120s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:16 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f50af7e1-4e3b-443c-8fe7-f89c13d57c79 Nov 02 10:54:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] Lock "cinder-quobyte-d1537b33-c612-4beb-89f5-1f17176fc9e4" released by "delete_snapshot" :: held 2.173s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:16 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:16 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] Created reservations ['a4745860-c07f-4845-a695-409a9d097189', '0ccb24eb-d6d6-4739-9913-fa900ab99055', 'f487ad77-f538-4b92-976e-863680053243', 'cfe484be-8602-4302-ac32-f47a73b54b98'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:16 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] Delete snapshot completed successfully. Nov 02 10:54:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42bddd17-4c53-40d5-96b4-e88041933652 tempest-VolumeDependencyTests-848256554 None] Lock "cinder-fdc9f2b6-bb51-4556-b0ff-5fbad89081cb-delete_snapshot" released by "delete_snapshot" :: held 2.426s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:16 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f50af7e1-4e3b-443c-8fe7-f89c13d57c79" returned: 0 in 0.394s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe0e162-647c-4ab9-ad33-3dcda79c7ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f50af7e1-4e3b-443c-8fe7-f89c13d57c79', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7b70c0-6b79-49bc-81a3-7b8b211fceca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:16 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Volume volume-f50af7e1-4e3b-443c-8fe7-f89c13d57c79 (f50af7e1-4e3b-443c-8fe7-f89c13d57c79): created successfully Nov 02 10:54:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7b70c0-6b79-49bc-81a3-7b8b211fceca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Flow 'volume_create_manager' (87b737d3-a5c8-4c41-8d8d-725e57ffd5ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:16 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b4b5540c-b2bb-4ff2-a431-f443d0242fbe tempest-CinderUnicodeTest-111130212 None] Created volume successfully. Nov 02 10:54:17 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_d87uoom3devstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710" returned: 0 in 2.090s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_918d0223-61d3-44de-a27f-c6e0b6ba1310_d87uoom3devstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:54:17 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Converted 112.00 MB image at 53.55 MB/s Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:17 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710 1G Nov 02 10:54:17 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a3780fc6-ccc9-4447-8ecc-53ea91694cb2 tempest-VolumeDependencyTests-848256554 None] Acquiring lock "cinder-d1537b33-c612-4beb-89f5-1f17176fc9e4-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a3780fc6-ccc9-4447-8ecc-53ea91694cb2 tempest-VolumeDependencyTests-848256554 None] Lock "cinder-d1537b33-c612-4beb-89f5-1f17176fc9e4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a3780fc6-ccc9-4447-8ecc-53ea91694cb2 tempest-VolumeDependencyTests-848256554 None] Acquiring lock "cinder-quobyte-d1537b33-c612-4beb-89f5-1f17176fc9e4" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a3780fc6-ccc9-4447-8ecc-53ea91694cb2 tempest-VolumeDependencyTests-848256554 None] Lock "cinder-quobyte-d1537b33-c612-4beb-89f5-1f17176fc9e4" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6674ed-95ce-4390-9e74-9609af7236f8]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3780fc6-ccc9-4447-8ecc-53ea91694cb2 tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:17 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710 1G" returned: 0 in 0.447s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Downloaded image 918d0223-61d3-44de-a27f-c6e0b6ba1310 ((None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}])) to volume a3370878-4f4e-43e8-b1ff-b706f8c1f710 successfully. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Temporary image 918d0223-61d3-44de-a27f-c6e0b6ba1310 for user b2bdd2ee81fd43ba84497b7640d7319a is deleted. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Marking volume a3370878-4f4e-43e8-b1ff-b706f8c1f710 as bootable. {{(pid=87084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Copying metadata from image 918d0223-61d3-44de-a27f-c6e0b6ba1310 to a3370878-4f4e-43e8-b1ff-b706f8c1f710. {{(pid=87084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Creating volume glance metadata for volume a3370878-4f4e-43e8-b1ff-b706f8c1f710 backed by image 918d0223-61d3-44de-a27f-c6e0b6ba1310 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:54:17 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 Nov 02 10:54:17 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463ff776-0a85-402f-99af-fa85d0655e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710', 'volume_size': 1, 'image_id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/918d0223-61d3-44de-a27f-c6e0b6ba1310', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9af457eb3c6844a99ee880354ae43eac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '918d0223-61d3-44de-a27f-c6e0b6ba1310', 'created_at': datetime.datetime(2026, 11, 2, 9, 33, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/918d0223-61d3-44de-a27f-c6e0b6ba1310/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489b0f07-61f3-446f-8f9c-789c432debe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:17 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Volume volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710 (a3370878-4f4e-43e8-b1ff-b706f8c1f710): created successfully Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489b0f07-61f3-446f-8f9c-789c432debe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Flow 'volume_create_manager' (73bcad31-ec1e-4519-b03e-f064b791664c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:17 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2ab97000-6f71-4eec-953b-ea7b592b92be tempest-VolumesExtendTest-379305718 None] Created volume successfully. Nov 02 10:54:17 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3780fc6-ccc9-4447-8ecc-53ea91694cb2 tempest-VolumeDependencyTests-848256554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4" returned: 0 in 0.492s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3780fc6-ccc9-4447-8ecc-53ea91694cb2 tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:17 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4 Nov 02 10:54:17 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:18 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Flow 'volume_create_manager' (a96115c0-950d-4913-b9ae-c9c760b904de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d0e77d-c0cc-4ab5-a271-7c12dd851033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3780fc6-ccc9-4447-8ecc-53ea91694cb2 tempest-VolumeDependencyTests-848256554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d1537b33-c612-4beb-89f5-1f17176fc9e4" returned: 0 in 0.299s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d0e77d-c0cc-4ab5-a271-7c12dd851033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1236709160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394529b3-d223-43ee-80a5-880ca5243189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7dac9ec2e0472693ed8031dc553c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:18Z,use_quota=True,user_id='b9856c12dc3a4f0a87ee771dc5c6eb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ee194d-1d11-40ce-94c4-482f889aeb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ee194d-1d11-40ce-94c4-482f889aeb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c185b16-6ef4-4867-985d-3ba8fbc58577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c185b16-6ef4-4867-985d-3ba8fbc58577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '394529b3-d223-43ee-80a5-880ca5243189', 'volume_name': 'volume-394529b3-d223-43ee-80a5-880ca5243189', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffab906d-8ff9-4849-b393-395ae18ae71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffab906d-8ff9-4849-b393-395ae18ae71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b430a49b-1a22-408c-9329-0a98ab70519f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:18 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Volume 394529b3-d223-43ee-80a5-880ca5243189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-394529b3-d223-43ee-80a5-880ca5243189', 'volume_size': 1} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1236709160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394529b3-d223-43ee-80a5-880ca5243189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7dac9ec2e0472693ed8031dc553c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:18Z,use_quota=True,user_id='b9856c12dc3a4f0a87ee771dc5c6eb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Creating volume 394529b3-d223-43ee-80a5-880ca5243189 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:18 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a3780fc6-ccc9-4447-8ecc-53ea91694cb2 tempest-VolumeDependencyTests-848256554 None] Lock "cinder-quobyte-d1537b33-c612-4beb-89f5-1f17176fc9e4" released by "delete_volume" :: held 0.953s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:18 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189 1073741824 Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-db00cf7a-3eca-4655-bacf-4705d425bc11 tempest-VolumesExtendTest-379305718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:18 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a3780fc6-ccc9-4447-8ecc-53ea91694cb2 tempest-VolumeDependencyTests-848256554 None] Created reservations ['5a9b91b5-bdcd-4edc-b21f-8b356f70b725', '2a32889c-f381-4536-b618-3034f45c872d', '98c9847c-76f3-4305-b9e4-7e122d8aedff', '610f22ee-dcc2-47cb-9a60-fb6a74cb4b46'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a3780fc6-ccc9-4447-8ecc-53ea91694cb2 tempest-VolumeDependencyTests-848256554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a3780fc6-ccc9-4447-8ecc-53ea91694cb2 tempest-VolumeDependencyTests-848256554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a3780fc6-ccc9-4447-8ecc-53ea91694cb2 tempest-VolumeDependencyTests-848256554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a3780fc6-ccc9-4447-8ecc-53ea91694cb2 tempest-VolumeDependencyTests-848256554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a3780fc6-ccc9-4447-8ecc-53ea91694cb2 tempest-VolumeDependencyTests-848256554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3780fc6-ccc9-4447-8ecc-53ea91694cb2 tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:18 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:54:18 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:18 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189 1073741824" returned: 0 in 0.505s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:18 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3780fc6-ccc9-4447-8ecc-53ea91694cb2 tempest-VolumeDependencyTests-848256554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.335s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-a3780fc6-ccc9-4447-8ecc-53ea91694cb2 tempest-VolumeDependencyTests-848256554 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:18 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a3780fc6-ccc9-4447-8ecc-53ea91694cb2 tempest-VolumeDependencyTests-848256554 None] Deleted volume successfully. Nov 02 10:54:18 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189 Nov 02 10:54:18 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a3780fc6-ccc9-4447-8ecc-53ea91694cb2 tempest-VolumeDependencyTests-848256554 None] Lock "cinder-d1537b33-c612-4beb-89f5-1f17176fc9e4-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:19 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189" returned: 0 in 0.285s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-db00cf7a-3eca-4655-bacf-4705d425bc11 tempest-VolumesExtendTest-379305718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.779s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b430a49b-1a22-408c-9329-0a98ab70519f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-394529b3-d223-43ee-80a5-880ca5243189', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6475656-fcd1-48fb-bef9-5c0f707a24b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:19 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0997370d-6cfa-4dd7-bd65-11acf048b85c]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db00cf7a-3eca-4655-bacf-4705d425bc11 tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:19 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Volume volume-394529b3-d223-43ee-80a5-880ca5243189 (394529b3-d223-43ee-80a5-880ca5243189): created successfully Nov 02 10:54:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6475656-fcd1-48fb-bef9-5c0f707a24b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Flow 'volume_create_manager' (a96115c0-950d-4913-b9ae-c9c760b904de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:19 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2a673c67-dc80-447f-ade8-f83a68174bf2 tempest-CinderUnicodeTest-111130212 None] Created volume successfully. Nov 02 10:54:19 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710 Nov 02 10:54:19 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:19 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db00cf7a-3eca-4655-bacf-4705d425bc11 tempest-VolumesExtendTest-379305718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710" returned: 0 in 0.425s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db00cf7a-3eca-4655-bacf-4705d425bc11 tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710 2G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-66d92123-3ff3-4b2e-9362-90b1969eaebe tempest-VolumeDependencyTests-848256554 None] Acquiring lock "cinder-7a54f2dc-5f95-4414-8196-631387b10db4-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-66d92123-3ff3-4b2e-9362-90b1969eaebe tempest-VolumeDependencyTests-848256554 None] Lock "cinder-7a54f2dc-5f95-4414-8196-631387b10db4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-66d92123-3ff3-4b2e-9362-90b1969eaebe tempest-VolumeDependencyTests-848256554 None] Acquiring lock "cinder-quobyte-7a54f2dc-5f95-4414-8196-631387b10db4" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-66d92123-3ff3-4b2e-9362-90b1969eaebe tempest-VolumeDependencyTests-848256554 None] Lock "cinder-quobyte-7a54f2dc-5f95-4414-8196-631387b10db4" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:19 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90930e6-783b-4504-b5f9-98f5cf988ebc]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-66d92123-3ff3-4b2e-9362-90b1969eaebe tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7a54f2dc-5f95-4414-8196-631387b10db4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db00cf7a-3eca-4655-bacf-4705d425bc11 tempest-VolumesExtendTest-379305718 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710 2G" returned: 0 in 0.153s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-db00cf7a-3eca-4655-bacf-4705d425bc11 tempest-VolumesExtendTest-379305718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.606s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:19 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-db00cf7a-3eca-4655-bacf-4705d425bc11 tempest-VolumesExtendTest-379305718 None] Extend volume completed successfully. Nov 02 10:54:19 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7a54f2dc-5f95-4414-8196-631387b10db4 Nov 02 10:54:19 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:20 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-66d92123-3ff3-4b2e-9362-90b1969eaebe tempest-VolumeDependencyTests-848256554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7a54f2dc-5f95-4414-8196-631387b10db4" returned: 0 in 0.411s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-66d92123-3ff3-4b2e-9362-90b1969eaebe tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7a54f2dc-5f95-4414-8196-631387b10db4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:20 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7a54f2dc-5f95-4414-8196-631387b10db4 Nov 02 10:54:20 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c8cea6bd-34e6-465a-9f09-07af58a3b86b tempest-CinderUnicodeTest-111130212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c8cea6bd-34e6-465a-9f09-07af58a3b86b tempest-CinderUnicodeTest-111130212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:20 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c8cea6bd-34e6-465a-9f09-07af58a3b86b tempest-CinderUnicodeTest-111130212 None] Creating offline snapshot b6f8d550-9dd2-4666-9a1e-630912f40fb1 of volume 394529b3-d223-43ee-80a5-880ca5243189 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-66d92123-3ff3-4b2e-9362-90b1969eaebe tempest-VolumeDependencyTests-848256554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7a54f2dc-5f95-4414-8196-631387b10db4" returned: 0 in 0.262s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-66d92123-3ff3-4b2e-9362-90b1969eaebe tempest-VolumeDependencyTests-848256554 None] Lock "cinder-quobyte-7a54f2dc-5f95-4414-8196-631387b10db4" released by "delete_volume" :: held 0.716s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[51834589-712d-42f9-9f93-3028edbfcf82]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c8cea6bd-34e6-465a-9f09-07af58a3b86b tempest-CinderUnicodeTest-111130212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-66d92123-3ff3-4b2e-9362-90b1969eaebe tempest-VolumeDependencyTests-848256554 None] Created reservations ['d904291a-0dac-4b43-bc5b-953711233fe5', '0dfeb332-7d8e-495a-9d7f-befc1d590c8b', 'da28d41d-5113-43bd-8f78-da83d08350b5', '45c9f485-ef2f-49da-be78-44c2070999c4'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:20 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189 Nov 02 10:54:20 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-66d92123-3ff3-4b2e-9362-90b1969eaebe tempest-VolumeDependencyTests-848256554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-66d92123-3ff3-4b2e-9362-90b1969eaebe tempest-VolumeDependencyTests-848256554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-66d92123-3ff3-4b2e-9362-90b1969eaebe tempest-VolumeDependencyTests-848256554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-66d92123-3ff3-4b2e-9362-90b1969eaebe tempest-VolumeDependencyTests-848256554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-66d92123-3ff3-4b2e-9362-90b1969eaebe tempest-VolumeDependencyTests-848256554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-66d92123-3ff3-4b2e-9362-90b1969eaebe tempest-VolumeDependencyTests-848256554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:20 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:54:20 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:20 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c8cea6bd-34e6-465a-9f09-07af58a3b86b tempest-CinderUnicodeTest-111130212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189" returned: 0 in 0.445s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c8cea6bd-34e6-465a-9f09-07af58a3b86b tempest-CinderUnicodeTest-111130212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.b6f8d550-9dd2-4666-9a1e-630912f40fb1 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:20 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-66d92123-3ff3-4b2e-9362-90b1969eaebe tempest-VolumeDependencyTests-848256554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.315s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-66d92123-3ff3-4b2e-9362-90b1969eaebe tempest-VolumeDependencyTests-848256554 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:20 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-66d92123-3ff3-4b2e-9362-90b1969eaebe tempest-VolumeDependencyTests-848256554 None] Deleted volume successfully. Nov 02 10:54:20 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.b6f8d550-9dd2-4666-9a1e-630912f40fb1 1G Nov 02 10:54:20 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-66d92123-3ff3-4b2e-9362-90b1969eaebe tempest-VolumeDependencyTests-848256554 None] Lock "cinder-7a54f2dc-5f95-4414-8196-631387b10db4-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e79ae5ab-c716-4daf-88e9-261e95a8c894 tempest-VolumesExtendTest-379305718 None] Acquiring lock "cinder-a3370878-4f4e-43e8-b1ff-b706f8c1f710-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e79ae5ab-c716-4daf-88e9-261e95a8c894 tempest-VolumesExtendTest-379305718 None] Lock "cinder-a3370878-4f4e-43e8-b1ff-b706f8c1f710-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e79ae5ab-c716-4daf-88e9-261e95a8c894 tempest-VolumesExtendTest-379305718 None] Acquiring lock "cinder-quobyte-a3370878-4f4e-43e8-b1ff-b706f8c1f710" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e79ae5ab-c716-4daf-88e9-261e95a8c894 tempest-VolumesExtendTest-379305718 None] Lock "cinder-quobyte-a3370878-4f4e-43e8-b1ff-b706f8c1f710" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:21 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca02f05-a270-491b-8b29-578fba77daf6]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e79ae5ab-c716-4daf-88e9-261e95a8c894 tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:21 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710 Nov 02 10:54:21 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:21 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c8cea6bd-34e6-465a-9f09-07af58a3b86b tempest-CinderUnicodeTest-111130212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.b6f8d550-9dd2-4666-9a1e-630912f40fb1 1G" returned: 0 in 0.559s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c8cea6bd-34e6-465a-9f09-07af58a3b86b tempest-CinderUnicodeTest-111130212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-394529b3-d223-43ee-80a5-880ca5243189 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.b6f8d550-9dd2-4666-9a1e-630912f40fb1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:21 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-394529b3-d223-43ee-80a5-880ca5243189 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.b6f8d550-9dd2-4666-9a1e-630912f40fb1 Nov 02 10:54:21 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:21 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e79ae5ab-c716-4daf-88e9-261e95a8c894 tempest-VolumesExtendTest-379305718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710" returned: 0 in 0.473s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e79ae5ab-c716-4daf-88e9-261e95a8c894 tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:21 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710 Nov 02 10:54:21 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:21 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c8cea6bd-34e6-465a-9f09-07af58a3b86b tempest-CinderUnicodeTest-111130212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-394529b3-d223-43ee-80a5-880ca5243189 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.b6f8d550-9dd2-4666-9a1e-630912f40fb1" returned: 0 in 0.398s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:21 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-c8cea6bd-34e6-465a-9f09-07af58a3b86b tempest-CinderUnicodeTest-111130212 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.b6f8d550-9dd2-4666-9a1e-630912f40fb1 is being set with open permissions: ugo+rw Nov 02 10:54:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c8cea6bd-34e6-465a-9f09-07af58a3b86b tempest-CinderUnicodeTest-111130212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.b6f8d550-9dd2-4666-9a1e-630912f40fb1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:21 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.b6f8d550-9dd2-4666-9a1e-630912f40fb1 Nov 02 10:54:21 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:21 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e79ae5ab-c716-4daf-88e9-261e95a8c894 tempest-VolumesExtendTest-379305718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3370878-4f4e-43e8-b1ff-b706f8c1f710" returned: 0 in 0.302s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e79ae5ab-c716-4daf-88e9-261e95a8c894 tempest-VolumesExtendTest-379305718 None] Lock "cinder-quobyte-a3370878-4f4e-43e8-b1ff-b706f8c1f710" released by "delete_volume" :: held 0.832s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:21 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-e79ae5ab-c716-4daf-88e9-261e95a8c894 tempest-VolumesExtendTest-379305718 None] Created reservations ['282d2695-bda8-4197-8f03-481fd9a2b454', '978101e0-e5be-4615-9146-db243fa1e33b', 'aabc43ca-b9f1-4375-a64c-300e1e4c857b', '80f6989e-6604-4b7f-8aec-a02f58b2aa69'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e79ae5ab-c716-4daf-88e9-261e95a8c894 tempest-VolumesExtendTest-379305718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e79ae5ab-c716-4daf-88e9-261e95a8c894 tempest-VolumesExtendTest-379305718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e79ae5ab-c716-4daf-88e9-261e95a8c894 tempest-VolumesExtendTest-379305718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e79ae5ab-c716-4daf-88e9-261e95a8c894 tempest-VolumesExtendTest-379305718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e79ae5ab-c716-4daf-88e9-261e95a8c894 tempest-VolumesExtendTest-379305718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e79ae5ab-c716-4daf-88e9-261e95a8c894 tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:22 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:22 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:54:22 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c8cea6bd-34e6-465a-9f09-07af58a3b86b tempest-CinderUnicodeTest-111130212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.b6f8d550-9dd2-4666-9a1e-630912f40fb1" returned: 0 in 0.271s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c8cea6bd-34e6-465a-9f09-07af58a3b86b tempest-CinderUnicodeTest-111130212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:22 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.info Nov 02 10:54:22 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:22 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e79ae5ab-c716-4daf-88e9-261e95a8c894 tempest-VolumesExtendTest-379305718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.319s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-e79ae5ab-c716-4daf-88e9-261e95a8c894 tempest-VolumesExtendTest-379305718 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:22 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e79ae5ab-c716-4daf-88e9-261e95a8c894 tempest-VolumesExtendTest-379305718 None] Deleted volume successfully. Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e79ae5ab-c716-4daf-88e9-261e95a8c894 tempest-VolumesExtendTest-379305718 None] Lock "cinder-a3370878-4f4e-43e8-b1ff-b706f8c1f710-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:22 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c8cea6bd-34e6-465a-9f09-07af58a3b86b tempest-CinderUnicodeTest-111130212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.info" returned: 0 in 0.394s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:22 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-c8cea6bd-34e6-465a-9f09-07af58a3b86b tempest-CinderUnicodeTest-111130212 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.info is being set with open permissions: ugo+rw Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c8cea6bd-34e6-465a-9f09-07af58a3b86b tempest-CinderUnicodeTest-111130212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:22 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.info Nov 02 10:54:22 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:22 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Flow 'volume_create_manager' (fd0b4265-4502-428c-8352-6aa1def14458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5d8797-9756-4b4a-9570-f8f65f37dd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c8cea6bd-34e6-465a-9f09-07af58a3b86b tempest-CinderUnicodeTest-111130212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.info" returned: 0 in 0.321s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c8cea6bd-34e6-465a-9f09-07af58a3b86b tempest-CinderUnicodeTest-111130212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5d8797-9756-4b4a-9570-f8f65f37dd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1140980196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e73a3a9373b640658127b9401bfc8d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:23Z,use_quota=True,user_id='b2bdd2ee81fd43ba84497b7640d7319a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954bf3a2-9d46-4dcf-9397-90613c519156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954bf3a2-9d46-4dcf-9397-90613c519156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d036426-2529-4d92-abd7-412e1360e2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d036426-2529-4d92-abd7-412e1360e2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6', 'volume_name': 'volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be586013-0af1-44d2-990a-e56a5854c934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be586013-0af1-44d2-990a-e56a5854c934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09adcbe5-f151-49e8-8aac-3f7a12ecfd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:22 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Volume 6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6', 'volume_size': 1} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1140980196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e73a3a9373b640658127b9401bfc8d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:23Z,use_quota=True,user_id='b2bdd2ee81fd43ba84497b7640d7319a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Creating volume 6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:22 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:54:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:22 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 1073741824 Nov 02 10:54:22 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:22 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c8cea6bd-34e6-465a-9f09-07af58a3b86b tempest-CinderUnicodeTest-111130212 None] Create snapshot completed successfully Nov 02 10:54:23 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 1073741824" returned: 0 in 0.468s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:23 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 Nov 02 10:54:23 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] Acquiring lock "cinder-b6f8d550-9dd2-4666-9a1e-630912f40fb1-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] Lock "cinder-b6f8d550-9dd2-4666-9a1e-630912f40fb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] Acquiring lock "cinder-quobyte-394529b3-d223-43ee-80a5-880ca5243189" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] Lock "cinder-quobyte-394529b3-d223-43ee-80a5-880ca5243189" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] Acquiring lock "cinder-quobyte-b6f8d550-9dd2-4666-9a1e-630912f40fb1" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] Lock "cinder-quobyte-b6f8d550-9dd2-4666-9a1e-630912f40fb1" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] Deleting offline snapshot b6f8d550-9dd2-4666-9a1e-630912f40fb1 of volume 394529b3-d223-43ee-80a5-880ca5243189 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:54:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] snapshot_file for this snap is: volume-394529b3-d223-43ee-80a5-880ca5243189.b6f8d550-9dd2-4666-9a1e-630912f40fb1 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:54:23 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f784ddc-abb3-409d-8883-1b2480ca5c22]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.b6f8d550-9dd2-4666-9a1e-630912f40fb1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:23 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6" returned: 0 in 0.301s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09adcbe5-f151-49e8-8aac-3f7a12ecfd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da7e47b3-b232-4099-8c8b-e9fd4cbdef32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:23 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Volume volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 (6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6): created successfully Nov 02 10:54:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da7e47b3-b232-4099-8c8b-e9fd4cbdef32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Flow 'volume_create_manager' (fd0b4265-4502-428c-8352-6aa1def14458) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e370b119-63b2-407d-9082-cfa3e45bbc4e tempest-VolumesExtendTest-379305718 None] Created volume successfully. Nov 02 10:54:23 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.b6f8d550-9dd2-4666-9a1e-630912f40fb1 Nov 02 10:54:23 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:24 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.b6f8d550-9dd2-4666-9a1e-630912f40fb1" returned: 0 in 0.406s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-394529b3-d223-43ee-80a5-880ca5243189(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:54:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0256c7c7-90fc-4a4c-94e6-285f3618e6e6]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:24 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189 Nov 02 10:54:24 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:24 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189" returned: 0 in 0.401s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.b6f8d550-9dd2-4666-9a1e-630912f40fb1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:24 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.b6f8d550-9dd2-4666-9a1e-630912f40fb1 Nov 02 10:54:24 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:24 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.b6f8d550-9dd2-4666-9a1e-630912f40fb1" returned: 0 in 0.417s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.b6f8d550-9dd2-4666-9a1e-630912f40fb1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:24 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.b6f8d550-9dd2-4666-9a1e-630912f40fb1 Nov 02 10:54:24 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-15861a81-9f0c-4e00-a3de-5ff513f606bf tempest-VolumesExtendTest-379305718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-15861a81-9f0c-4e00-a3de-5ff513f606bf tempest-VolumesExtendTest-379305718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-15861a81-9f0c-4e00-a3de-5ff513f606bf tempest-VolumesExtendTest-379305718 None] Creating offline snapshot 17f38a73-1772-436c-b1ff-ad9d416b20c9 of volume 6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:54:25 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e052ab9-0124-4697-a713-6ae960e136d2]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15861a81-9f0c-4e00-a3de-5ff513f606bf tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:25 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 Nov 02 10:54:25 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:25 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189.b6f8d550-9dd2-4666-9a1e-630912f40fb1" returned: 0 in 0.397s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] Lock "cinder-quobyte-b6f8d550-9dd2-4666-9a1e-630912f40fb1" released by "_delete_snapshot" :: held 1.766s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] Lock "cinder-quobyte-394529b3-d223-43ee-80a5-880ca5243189" released by "delete_snapshot" :: held 1.802s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:25 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] Created reservations ['5a30a071-31ae-4c75-8f85-2e913c698a78', '6f91c88e-8d6f-4b43-9b1b-40eca296c7ba', '243f0e12-eadd-40b3-8715-4ab78150abba', '06158d0e-e68a-429c-aff6-fc338907028e'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:25 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] Delete snapshot completed successfully. Nov 02 10:54:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-960b9de7-0540-48ec-8fb1-63e871992d8f tempest-CinderUnicodeTest-111130212 None] Lock "cinder-b6f8d550-9dd2-4666-9a1e-630912f40fb1-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:25 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15861a81-9f0c-4e00-a3de-5ff513f606bf tempest-VolumesExtendTest-379305718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6" returned: 0 in 0.429s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15861a81-9f0c-4e00-a3de-5ff513f606bf tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:25 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9 1G Nov 02 10:54:25 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39974246-3878-4b5f-a91e-855ddbf5cdbf tempest-CinderUnicodeTest-111130212 None] Acquiring lock "cinder-394529b3-d223-43ee-80a5-880ca5243189-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39974246-3878-4b5f-a91e-855ddbf5cdbf tempest-CinderUnicodeTest-111130212 None] Lock "cinder-394529b3-d223-43ee-80a5-880ca5243189-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39974246-3878-4b5f-a91e-855ddbf5cdbf tempest-CinderUnicodeTest-111130212 None] Acquiring lock "cinder-quobyte-394529b3-d223-43ee-80a5-880ca5243189" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39974246-3878-4b5f-a91e-855ddbf5cdbf tempest-CinderUnicodeTest-111130212 None] Lock "cinder-quobyte-394529b3-d223-43ee-80a5-880ca5243189" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:25 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[11621a35-4708-42a9-9466-53abc0c84e51]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39974246-3878-4b5f-a91e-855ddbf5cdbf tempest-CinderUnicodeTest-111130212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:26 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189 Nov 02 10:54:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15861a81-9f0c-4e00-a3de-5ff513f606bf tempest-VolumesExtendTest-379305718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9 1G" returned: 0 in 0.471s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:26 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:26 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15861a81-9f0c-4e00-a3de-5ff513f606bf tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:26 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9 Nov 02 10:54:26 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:26 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39974246-3878-4b5f-a91e-855ddbf5cdbf tempest-CinderUnicodeTest-111130212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189" returned: 0 in 0.414s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39974246-3878-4b5f-a91e-855ddbf5cdbf tempest-CinderUnicodeTest-111130212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:26 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15861a81-9f0c-4e00-a3de-5ff513f606bf tempest-VolumesExtendTest-379305718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9" returned: 0 in 0.314s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:26 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-15861a81-9f0c-4e00-a3de-5ff513f606bf tempest-VolumesExtendTest-379305718 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9 is being set with open permissions: ugo+rw Nov 02 10:54:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15861a81-9f0c-4e00-a3de-5ff513f606bf tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:26 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189 Nov 02 10:54:26 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:26 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9 Nov 02 10:54:26 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:26 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39974246-3878-4b5f-a91e-855ddbf5cdbf tempest-CinderUnicodeTest-111130212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-394529b3-d223-43ee-80a5-880ca5243189" returned: 0 in 0.276s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:26 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15861a81-9f0c-4e00-a3de-5ff513f606bf tempest-VolumesExtendTest-379305718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9" returned: 0 in 0.279s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39974246-3878-4b5f-a91e-855ddbf5cdbf tempest-CinderUnicodeTest-111130212 None] Lock "cinder-quobyte-394529b3-d223-43ee-80a5-880ca5243189" released by "delete_volume" :: held 0.774s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15861a81-9f0c-4e00-a3de-5ff513f606bf tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:26 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.info Nov 02 10:54:26 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:26 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-39974246-3878-4b5f-a91e-855ddbf5cdbf tempest-CinderUnicodeTest-111130212 None] Created reservations ['62b12246-2214-4fd8-a141-eb10bd1956e4', '1572c21f-81e5-47c4-922e-528f7a72ef1b', '5ac51f6f-6ed0-4b08-b69f-929b764eef9f', '8b8e288a-e25c-48b5-9080-17e1ca39d883'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-39974246-3878-4b5f-a91e-855ddbf5cdbf tempest-CinderUnicodeTest-111130212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-39974246-3878-4b5f-a91e-855ddbf5cdbf tempest-CinderUnicodeTest-111130212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-39974246-3878-4b5f-a91e-855ddbf5cdbf tempest-CinderUnicodeTest-111130212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-39974246-3878-4b5f-a91e-855ddbf5cdbf tempest-CinderUnicodeTest-111130212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-39974246-3878-4b5f-a91e-855ddbf5cdbf tempest-CinderUnicodeTest-111130212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39974246-3878-4b5f-a91e-855ddbf5cdbf tempest-CinderUnicodeTest-111130212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:26 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:54:26 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:27 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a1bb1a56-98c2-4150-aac9-d040ed9684b0 tempest-CinderUnicodeTest-111130212 None] Acquiring lock "cinder-f50af7e1-4e3b-443c-8fe7-f89c13d57c79-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15861a81-9f0c-4e00-a3de-5ff513f606bf tempest-VolumesExtendTest-379305718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.info" returned: 0 in 0.312s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:27 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-15861a81-9f0c-4e00-a3de-5ff513f606bf tempest-VolumesExtendTest-379305718 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.info is being set with open permissions: ugo+rw Nov 02 10:54:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15861a81-9f0c-4e00-a3de-5ff513f606bf tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a1bb1a56-98c2-4150-aac9-d040ed9684b0 tempest-CinderUnicodeTest-111130212 None] Lock "cinder-f50af7e1-4e3b-443c-8fe7-f89c13d57c79-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:27 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.info Nov 02 10:54:27 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a1bb1a56-98c2-4150-aac9-d040ed9684b0 tempest-CinderUnicodeTest-111130212 None] Acquiring lock "cinder-quobyte-f50af7e1-4e3b-443c-8fe7-f89c13d57c79" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a1bb1a56-98c2-4150-aac9-d040ed9684b0 tempest-CinderUnicodeTest-111130212 None] Lock "cinder-quobyte-f50af7e1-4e3b-443c-8fe7-f89c13d57c79" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:27 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39974246-3878-4b5f-a91e-855ddbf5cdbf tempest-CinderUnicodeTest-111130212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.333s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:27 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-39974246-3878-4b5f-a91e-855ddbf5cdbf tempest-CinderUnicodeTest-111130212 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:27 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[02848ffd-364a-4d90-a8b1-1142472c0c65]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a1bb1a56-98c2-4150-aac9-d040ed9684b0 tempest-CinderUnicodeTest-111130212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f50af7e1-4e3b-443c-8fe7-f89c13d57c79 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:27 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-39974246-3878-4b5f-a91e-855ddbf5cdbf tempest-CinderUnicodeTest-111130212 None] Deleted volume successfully. Nov 02 10:54:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39974246-3878-4b5f-a91e-855ddbf5cdbf tempest-CinderUnicodeTest-111130212 None] Lock "cinder-394529b3-d223-43ee-80a5-880ca5243189-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:27 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f50af7e1-4e3b-443c-8fe7-f89c13d57c79 Nov 02 10:54:27 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:27 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15861a81-9f0c-4e00-a3de-5ff513f606bf tempest-VolumesExtendTest-379305718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.info" returned: 0 in 0.342s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-15861a81-9f0c-4e00-a3de-5ff513f606bf tempest-VolumesExtendTest-379305718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.266s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:27 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-15861a81-9f0c-4e00-a3de-5ff513f606bf tempest-VolumesExtendTest-379305718 None] Create snapshot completed successfully Nov 02 10:54:27 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a1bb1a56-98c2-4150-aac9-d040ed9684b0 tempest-CinderUnicodeTest-111130212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f50af7e1-4e3b-443c-8fe7-f89c13d57c79" returned: 0 in 0.443s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a1bb1a56-98c2-4150-aac9-d040ed9684b0 tempest-CinderUnicodeTest-111130212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f50af7e1-4e3b-443c-8fe7-f89c13d57c79 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:27 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f50af7e1-4e3b-443c-8fe7-f89c13d57c79 Nov 02 10:54:27 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:27 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a1bb1a56-98c2-4150-aac9-d040ed9684b0 tempest-CinderUnicodeTest-111130212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f50af7e1-4e3b-443c-8fe7-f89c13d57c79" returned: 0 in 0.280s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a1bb1a56-98c2-4150-aac9-d040ed9684b0 tempest-CinderUnicodeTest-111130212 None] Lock "cinder-quobyte-f50af7e1-4e3b-443c-8fe7-f89c13d57c79" released by "delete_volume" :: held 0.791s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:27 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a1bb1a56-98c2-4150-aac9-d040ed9684b0 tempest-CinderUnicodeTest-111130212 None] Created reservations ['9b3df4bf-ccd8-4152-86c5-c2d3f1f0b97f', 'e3f0d8f4-9837-4619-bf5d-e5021f4d944b', '8e9e8d1b-e52b-44a5-a541-86a0cf551aa3', '4c5e743a-6207-48d2-b6cc-8703cc058101'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a1bb1a56-98c2-4150-aac9-d040ed9684b0 tempest-CinderUnicodeTest-111130212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a1bb1a56-98c2-4150-aac9-d040ed9684b0 tempest-CinderUnicodeTest-111130212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a1bb1a56-98c2-4150-aac9-d040ed9684b0 tempest-CinderUnicodeTest-111130212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a1bb1a56-98c2-4150-aac9-d040ed9684b0 tempest-CinderUnicodeTest-111130212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a1bb1a56-98c2-4150-aac9-d040ed9684b0 tempest-CinderUnicodeTest-111130212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a1bb1a56-98c2-4150-aac9-d040ed9684b0 tempest-CinderUnicodeTest-111130212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:28 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:54:28 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:28 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a1bb1a56-98c2-4150-aac9-d040ed9684b0 tempest-CinderUnicodeTest-111130212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.275s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:28 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-a1bb1a56-98c2-4150-aac9-d040ed9684b0 tempest-CinderUnicodeTest-111130212 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:28 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a1bb1a56-98c2-4150-aac9-d040ed9684b0 tempest-CinderUnicodeTest-111130212 None] Deleted volume successfully. Nov 02 10:54:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a1bb1a56-98c2-4150-aac9-d040ed9684b0 tempest-CinderUnicodeTest-111130212 None] Lock "cinder-f50af7e1-4e3b-443c-8fe7-f89c13d57c79-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6dafa33d-3bf5-417e-b7ed-8c7df25fa9aa tempest-VolumesExtendTest-379305718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6dafa33d-3bf5-417e-b7ed-8c7df25fa9aa tempest-VolumesExtendTest-379305718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:28 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d73631-eb2e-475e-9220-a2daa91e7325]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6dafa33d-3bf5-417e-b7ed-8c7df25fa9aa tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:28 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 Nov 02 10:54:28 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:28 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6dafa33d-3bf5-417e-b7ed-8c7df25fa9aa tempest-VolumesExtendTest-379305718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6" returned: 0 in 0.414s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6dafa33d-3bf5-417e-b7ed-8c7df25fa9aa tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9 2G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6dafa33d-3bf5-417e-b7ed-8c7df25fa9aa tempest-VolumesExtendTest-379305718 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9 2G" returned: 0 in 0.177s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6dafa33d-3bf5-417e-b7ed-8c7df25fa9aa tempest-VolumesExtendTest-379305718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.633s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6dafa33d-3bf5-417e-b7ed-8c7df25fa9aa tempest-VolumesExtendTest-379305718 None] Extend volume completed successfully. Nov 02 10:54:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] Acquiring lock "cinder-17f38a73-1772-436c-b1ff-ad9d416b20c9-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] Lock "cinder-17f38a73-1772-436c-b1ff-ad9d416b20c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] Acquiring lock "cinder-quobyte-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] Lock "cinder-quobyte-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] Acquiring lock "cinder-quobyte-17f38a73-1772-436c-b1ff-ad9d416b20c9" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] Lock "cinder-quobyte-17f38a73-1772-436c-b1ff-ad9d416b20c9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] Deleting offline snapshot 17f38a73-1772-436c-b1ff-ad9d416b20c9 of volume 6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:54:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] snapshot_file for this snap is: volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:54:29 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b537326c-0f4f-41ec-b24a-a4511c026b8a]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:29 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9 Nov 02 10:54:29 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:30 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9" returned: 0 in 0.372s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:54:30 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdcfe13-de1a-42b2-a198-b68edf0d734b]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:30 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 Nov 02 10:54:30 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:30 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6" returned: 0 in 0.357s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:30 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9 Nov 02 10:54:30 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:30 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9" returned: 0 in 0.377s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:30 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9 Nov 02 10:54:30 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:31 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6.17f38a73-1772-436c-b1ff-ad9d416b20c9" returned: 0 in 0.253s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] Lock "cinder-quobyte-17f38a73-1772-436c-b1ff-ad9d416b20c9" released by "_delete_snapshot" :: held 1.467s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] Lock "cinder-quobyte-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6" released by "delete_snapshot" :: held 1.489s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:31 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] Created reservations ['777372d3-fa1d-44c7-af25-72f867428505', '76a1ec5a-5cd5-4dbe-8fbf-201577bccaed', '5dd3d05c-f4dd-4334-857f-5ce7f8df77d3', 'c6dccff1-b485-4030-acb6-8540d928b7e2'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] Delete snapshot completed successfully. Nov 02 10:54:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a9260b4b-d053-4ee2-8a81-53a28b13a44a tempest-VolumesExtendTest-379305718 None] Lock "cinder-17f38a73-1772-436c-b1ff-ad9d416b20c9-delete_snapshot" released by "delete_snapshot" :: held 1.626s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85de153e-bb9a-4d03-ad93-14c5f4abd342 tempest-VolumesExtendTest-379305718 None] Acquiring lock "cinder-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85de153e-bb9a-4d03-ad93-14c5f4abd342 tempest-VolumesExtendTest-379305718 None] Lock "cinder-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85de153e-bb9a-4d03-ad93-14c5f4abd342 tempest-VolumesExtendTest-379305718 None] Acquiring lock "cinder-quobyte-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85de153e-bb9a-4d03-ad93-14c5f4abd342 tempest-VolumesExtendTest-379305718 None] Lock "cinder-quobyte-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:32 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c898d8a-3dff-46cc-9dc0-8360a5574be6]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85de153e-bb9a-4d03-ad93-14c5f4abd342 tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:32 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 Nov 02 10:54:32 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:32 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85de153e-bb9a-4d03-ad93-14c5f4abd342 tempest-VolumesExtendTest-379305718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6" returned: 0 in 0.381s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85de153e-bb9a-4d03-ad93-14c5f4abd342 tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:32 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6 Nov 02 10:54:32 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:32 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85de153e-bb9a-4d03-ad93-14c5f4abd342 tempest-VolumesExtendTest-379305718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6" returned: 0 in 0.256s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85de153e-bb9a-4d03-ad93-14c5f4abd342 tempest-VolumesExtendTest-379305718 None] Lock "cinder-quobyte-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6" released by "delete_volume" :: held 0.726s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:32 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-85de153e-bb9a-4d03-ad93-14c5f4abd342 tempest-VolumesExtendTest-379305718 None] Created reservations ['afc66566-bd02-4cc2-99db-64ed4c76cc20', 'd7feebe9-bc39-497f-9d13-b8f7546eaf2d', 'ef6624fa-9fa1-4000-8bef-b20086498f36', 'a49c0293-5316-48d5-bd81-ad0477f7757a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-85de153e-bb9a-4d03-ad93-14c5f4abd342 tempest-VolumesExtendTest-379305718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-85de153e-bb9a-4d03-ad93-14c5f4abd342 tempest-VolumesExtendTest-379305718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-85de153e-bb9a-4d03-ad93-14c5f4abd342 tempest-VolumesExtendTest-379305718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-85de153e-bb9a-4d03-ad93-14c5f4abd342 tempest-VolumesExtendTest-379305718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-85de153e-bb9a-4d03-ad93-14c5f4abd342 tempest-VolumesExtendTest-379305718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85de153e-bb9a-4d03-ad93-14c5f4abd342 tempest-VolumesExtendTest-379305718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:32 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:54:32 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:33 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85de153e-bb9a-4d03-ad93-14c5f4abd342 tempest-VolumesExtendTest-379305718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.259s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:33 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-85de153e-bb9a-4d03-ad93-14c5f4abd342 tempest-VolumesExtendTest-379305718 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-85de153e-bb9a-4d03-ad93-14c5f4abd342 tempest-VolumesExtendTest-379305718 None] Deleted volume successfully. Nov 02 10:54:33 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85de153e-bb9a-4d03-ad93-14c5f4abd342 tempest-VolumesExtendTest-379305718 None] Lock "cinder-6ae3b2a5-0aeb-4dcd-b80a-059e43d517b6-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:36 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Flow 'volume_create_manager' (3684756c-84ed-4adc-95db-a34bcd028f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb58c00-39d2-4c12-8b5c-226f31db3c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb58c00-39d2-4c12-8b5c-226f31db3c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-673650420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f21c992-79c6-4371-aa3d-a9ad56b62f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a55d04ed9414d7d993b5992fe983184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:37Z,use_quota=True,user_id='60094ddd1d9042879d7e473ac2d77316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d794859-89c3-4261-8343-13ba734b75d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d794859-89c3-4261-8343-13ba734b75d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d7f15f-4877-4456-bb80-f1ad4db8a619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d7f15f-4877-4456-bb80-f1ad4db8a619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f21c992-79c6-4371-aa3d-a9ad56b62f61', 'volume_name': 'volume-3f21c992-79c6-4371-aa3d-a9ad56b62f61', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8c8b52b-b14b-4c8d-9829-7f546939bc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8c8b52b-b14b-4c8d-9829-7f546939bc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5b68f4-b9b7-49e9-849b-3d2ed84b13fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:37 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Volume 3f21c992-79c6-4371-aa3d-a9ad56b62f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f21c992-79c6-4371-aa3d-a9ad56b62f61', 'volume_size': 1} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-673650420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f21c992-79c6-4371-aa3d-a9ad56b62f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a55d04ed9414d7d993b5992fe983184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:37Z,use_quota=True,user_id='60094ddd1d9042879d7e473ac2d77316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Creating volume 3f21c992-79c6-4371-aa3d-a9ad56b62f61 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:37 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3f21c992-79c6-4371-aa3d-a9ad56b62f61 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:37 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3f21c992-79c6-4371-aa3d-a9ad56b62f61 1073741824 Nov 02 10:54:37 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Flow 'volume_create_manager' (99c2e473-a813-4c22-a056-0cd81dfe8d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32aff8a5-c6ef-4d87-a9ee-73526d56346d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32aff8a5-c6ef-4d87-a9ee-73526d56346d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-934546315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2065a423-9856-4279-9c7b-81dbc5305e2c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='704e563a42ec4b178c50688e3450da4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:37Z,use_quota=True,user_id='44ce5d572a0e4f438648b65e6654de77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c15c5ab-9c5e-45cc-9e93-adf79217d213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c15c5ab-9c5e-45cc-9e93-adf79217d213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e15ebd2-e2c9-4546-b0a0-ddf1f7ff6f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e15ebd2-e2c9-4546-b0a0-ddf1f7ff6f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2065a423-9856-4279-9c7b-81dbc5305e2c', 'volume_name': 'volume-2065a423-9856-4279-9c7b-81dbc5305e2c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5937db30-422e-4d36-a8c6-d9fe114153af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5937db30-422e-4d36-a8c6-d9fe114153af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7414ed8b-4779-47fe-bee7-b17d3cc5cee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:37 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Volume 2065a423-9856-4279-9c7b-81dbc5305e2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2065a423-9856-4279-9c7b-81dbc5305e2c', 'volume_size': 1} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:37 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3f21c992-79c6-4371-aa3d-a9ad56b62f61 1073741824" returned: 0 in 0.419s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3f21c992-79c6-4371-aa3d-a9ad56b62f61 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:37 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3f21c992-79c6-4371-aa3d-a9ad56b62f61 Nov 02 10:54:37 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:37 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3f21c992-79c6-4371-aa3d-a9ad56b62f61" returned: 0 in 0.237s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.559s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-934546315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2065a423-9856-4279-9c7b-81dbc5305e2c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='704e563a42ec4b178c50688e3450da4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:37Z,use_quota=True,user_id='44ce5d572a0e4f438648b65e6654de77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Creating volume 2065a423-9856-4279-9c7b-81dbc5305e2c {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:37 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2065a423-9856-4279-9c7b-81dbc5305e2c 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:37 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2065a423-9856-4279-9c7b-81dbc5305e2c 1073741824 Nov 02 10:54:37 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5b68f4-b9b7-49e9-849b-3d2ed84b13fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f21c992-79c6-4371-aa3d-a9ad56b62f61', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63f1310-1786-4bd7-bd23-f2a547ccd2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:37 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Volume volume-3f21c992-79c6-4371-aa3d-a9ad56b62f61 (3f21c992-79c6-4371-aa3d-a9ad56b62f61): created successfully Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63f1310-1786-4bd7-bd23-f2a547ccd2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Flow 'volume_create_manager' (3684756c-84ed-4adc-95db-a34bcd028f51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f0c3fe29-0e05-4249-8849-d612261505cf tempest-ProjectReaderTests-1619730515 None] Created volume successfully. Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e30f2178-ca20-4ccf-a580-009d1d615c1b tempest-ProjectReaderTests-1619730515 None] Acquiring lock "cinder-3f21c992-79c6-4371-aa3d-a9ad56b62f61-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e30f2178-ca20-4ccf-a580-009d1d615c1b tempest-ProjectReaderTests-1619730515 None] Lock "cinder-3f21c992-79c6-4371-aa3d-a9ad56b62f61-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e30f2178-ca20-4ccf-a580-009d1d615c1b tempest-ProjectReaderTests-1619730515 None] Acquiring lock "cinder-quobyte-3f21c992-79c6-4371-aa3d-a9ad56b62f61" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e30f2178-ca20-4ccf-a580-009d1d615c1b tempest-ProjectReaderTests-1619730515 None] Lock "cinder-quobyte-3f21c992-79c6-4371-aa3d-a9ad56b62f61" acquired by "delete_volume" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7252c42-a8d4-44db-be50-ec427c9ca730]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e30f2178-ca20-4ccf-a580-009d1d615c1b tempest-ProjectReaderTests-1619730515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3f21c992-79c6-4371-aa3d-a9ad56b62f61 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:38 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2065a423-9856-4279-9c7b-81dbc5305e2c 1073741824" returned: 0 in 0.496s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2065a423-9856-4279-9c7b-81dbc5305e2c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:38 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3f21c992-79c6-4371-aa3d-a9ad56b62f61 Nov 02 10:54:38 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:38 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2065a423-9856-4279-9c7b-81dbc5305e2c Nov 02 10:54:38 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:38 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2065a423-9856-4279-9c7b-81dbc5305e2c" returned: 0 in 0.243s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=168,cinder:INSERT=55,cinder:UPDATE=220,cinder:DELETE=22 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7414ed8b-4779-47fe-bee7-b17d3cc5cee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2065a423-9856-4279-9c7b-81dbc5305e2c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f2ca7df-d6e7-4ede-a20f-2b10ca36a0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=211,cinder:SELECT=178,cinder:DELETE=14,cinder:INSERT=68 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:54:38 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Volume volume-2065a423-9856-4279-9c7b-81dbc5305e2c (2065a423-9856-4279-9c7b-81dbc5305e2c): created successfully Nov 02 10:54:38 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f2ca7df-d6e7-4ede-a20f-2b10ca36a0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Flow 'volume_create_manager' (99c2e473-a813-4c22-a056-0cd81dfe8d21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e30f2178-ca20-4ccf-a580-009d1d615c1b tempest-ProjectReaderTests-1619730515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3f21c992-79c6-4371-aa3d-a9ad56b62f61" returned: 0 in 0.395s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e30f2178-ca20-4ccf-a580-009d1d615c1b tempest-ProjectReaderTests-1619730515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3f21c992-79c6-4371-aa3d-a9ad56b62f61 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:38 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a1e21047-3209-4607-a508-68a1d3cd93da tempest-VolumesListTestJSON-1311865080 None] Created volume successfully. Nov 02 10:54:38 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3f21c992-79c6-4371-aa3d-a9ad56b62f61 Nov 02 10:54:38 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:38 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e30f2178-ca20-4ccf-a580-009d1d615c1b tempest-ProjectReaderTests-1619730515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3f21c992-79c6-4371-aa3d-a9ad56b62f61" returned: 0 in 0.263s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e30f2178-ca20-4ccf-a580-009d1d615c1b tempest-ProjectReaderTests-1619730515 None] Lock "cinder-quobyte-3f21c992-79c6-4371-aa3d-a9ad56b62f61" released by "delete_volume" :: held 0.699s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-e30f2178-ca20-4ccf-a580-009d1d615c1b tempest-ProjectReaderTests-1619730515 None] Created reservations ['75ff03eb-fa44-45f6-ad99-7087ddedf60e', '2bc4b0bf-c6d2-465c-aed7-c52976aaf739', '4bca6cf7-8c5e-4fb2-821a-f72465ede9bf', '3c3a17cc-f81b-448b-96df-de834d9fcbc6'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e30f2178-ca20-4ccf-a580-009d1d615c1b tempest-ProjectReaderTests-1619730515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e30f2178-ca20-4ccf-a580-009d1d615c1b tempest-ProjectReaderTests-1619730515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e30f2178-ca20-4ccf-a580-009d1d615c1b tempest-ProjectReaderTests-1619730515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e30f2178-ca20-4ccf-a580-009d1d615c1b tempest-ProjectReaderTests-1619730515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e30f2178-ca20-4ccf-a580-009d1d615c1b tempest-ProjectReaderTests-1619730515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e30f2178-ca20-4ccf-a580-009d1d615c1b tempest-ProjectReaderTests-1619730515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:38 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:54:38 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:39 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e30f2178-ca20-4ccf-a580-009d1d615c1b tempest-ProjectReaderTests-1619730515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.293s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-e30f2178-ca20-4ccf-a580-009d1d615c1b tempest-ProjectReaderTests-1619730515 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:39 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e30f2178-ca20-4ccf-a580-009d1d615c1b tempest-ProjectReaderTests-1619730515 None] Deleted volume successfully. Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e30f2178-ca20-4ccf-a580-009d1d615c1b tempest-ProjectReaderTests-1619730515 None] Lock "cinder-3f21c992-79c6-4371-aa3d-a9ad56b62f61-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Flow 'volume_create_manager' (f1214db7-8b52-4ec9-8f3e-027497a2b1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14dc621c-3daf-435b-af18-e82707ff6106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14dc621c-3daf-435b-af18-e82707ff6106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1142545038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb2203d7-02f1-42f3-ae58-20f178271c45,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='704e563a42ec4b178c50688e3450da4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:40Z,use_quota=True,user_id='44ce5d572a0e4f438648b65e6654de77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f80d53c-c6a6-4a7d-a003-3694875f8b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f80d53c-c6a6-4a7d-a003-3694875f8b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1140eb-de45-4188-af51-5079aa333fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1140eb-de45-4188-af51-5079aa333fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb2203d7-02f1-42f3-ae58-20f178271c45', 'volume_name': 'volume-eb2203d7-02f1-42f3-ae58-20f178271c45', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d24a2e-3357-4c8f-8286-22766076210e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d24a2e-3357-4c8f-8286-22766076210e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b773273-a61d-40ab-ab92-dc43e7befd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Volume eb2203d7-02f1-42f3-ae58-20f178271c45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb2203d7-02f1-42f3-ae58-20f178271c45', 'volume_size': 1} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1142545038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb2203d7-02f1-42f3-ae58-20f178271c45,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='704e563a42ec4b178c50688e3450da4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:40Z,use_quota=True,user_id='44ce5d572a0e4f438648b65e6654de77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Creating volume eb2203d7-02f1-42f3-ae58-20f178271c45 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:39 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-eb2203d7-02f1-42f3-ae58-20f178271c45 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:39 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-eb2203d7-02f1-42f3-ae58-20f178271c45 1073741824 Nov 02 10:54:39 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Flow 'volume_create_manager' (d2ba3678-4723-4a16-b7c9-39361ff9354b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec9e8b7-b8ed-496d-803c-5370e0c0920e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec9e8b7-b8ed-496d-803c-5370e0c0920e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-874594904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5a0f20-c982-4e1e-b491-199ae1a9942b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a55d04ed9414d7d993b5992fe983184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:40Z,use_quota=True,user_id='60094ddd1d9042879d7e473ac2d77316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629bfa7b-139c-4949-bdfe-12a1a36b8f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629bfa7b-139c-4949-bdfe-12a1a36b8f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac3694ff-907a-4d38-9215-5266fe7b813d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac3694ff-907a-4d38-9215-5266fe7b813d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e5a0f20-c982-4e1e-b491-199ae1a9942b', 'volume_name': 'volume-4e5a0f20-c982-4e1e-b491-199ae1a9942b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e866266-0db9-4570-b0e7-9acbcf47bff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e866266-0db9-4570-b0e7-9acbcf47bff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1bca64-78fa-4379-9376-0e8223f97de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:40 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Volume 4e5a0f20-c982-4e1e-b491-199ae1a9942b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e5a0f20-c982-4e1e-b491-199ae1a9942b', 'volume_size': 1} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:40 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-eb2203d7-02f1-42f3-ae58-20f178271c45 1073741824" returned: 0 in 0.550s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-eb2203d7-02f1-42f3-ae58-20f178271c45 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:40 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-eb2203d7-02f1-42f3-ae58-20f178271c45 Nov 02 10:54:40 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:40 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-eb2203d7-02f1-42f3-ae58-20f178271c45" returned: 0 in 0.412s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.848s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-874594904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5a0f20-c982-4e1e-b491-199ae1a9942b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a55d04ed9414d7d993b5992fe983184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:40Z,use_quota=True,user_id='60094ddd1d9042879d7e473ac2d77316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Creating volume 4e5a0f20-c982-4e1e-b491-199ae1a9942b {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:40 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5a0f20-c982-4e1e-b491-199ae1a9942b 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:40 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5a0f20-c982-4e1e-b491-199ae1a9942b 1073741824 Nov 02 10:54:40 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b773273-a61d-40ab-ab92-dc43e7befd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb2203d7-02f1-42f3-ae58-20f178271c45', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36d7955-ba8c-4314-a01b-b2ca6658aad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:40 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Volume volume-eb2203d7-02f1-42f3-ae58-20f178271c45 (eb2203d7-02f1-42f3-ae58-20f178271c45): created successfully Nov 02 10:54:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36d7955-ba8c-4314-a01b-b2ca6658aad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Flow 'volume_create_manager' (f1214db7-8b52-4ec9-8f3e-027497a2b1a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d2d83183-2644-4463-9e12-744aa7116d56 tempest-VolumesListTestJSON-1311865080 None] Created volume successfully. Nov 02 10:54:41 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5a0f20-c982-4e1e-b491-199ae1a9942b 1073741824" returned: 0 in 0.553s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5a0f20-c982-4e1e-b491-199ae1a9942b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:41 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5a0f20-c982-4e1e-b491-199ae1a9942b Nov 02 10:54:41 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-da74f1f8-f8f3-46ac-b55b-9eb545eceff3 tempest-TestShelveInstance-1326132134 None] Terminate volume connection completed successfully. Nov 02 10:54:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-da74f1f8-f8f3-46ac-b55b-9eb545eceff3 tempest-TestShelveInstance-1326132134 None] Deleting attachment 4b9f6134-2c8a-44a1-87a7-81f2b676f0cd. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:54:41 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5a0f20-c982-4e1e-b491-199ae1a9942b" returned: 0 in 0.263s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1bca64-78fa-4379-9376-0e8223f97de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e5a0f20-c982-4e1e-b491-199ae1a9942b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28d92a9-ecab-4145-9b87-205fd15d5bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Volume volume-4e5a0f20-c982-4e1e-b491-199ae1a9942b (4e5a0f20-c982-4e1e-b491-199ae1a9942b): created successfully Nov 02 10:54:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28d92a9-ecab-4145-9b87-205fd15d5bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Flow 'volume_create_manager' (d2ba3678-4723-4a16-b7c9-39361ff9354b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-868cb805-ac8a-4056-833e-1eb07c48ed4b tempest-ProjectReaderTests-1619730515 None] Created volume successfully. Nov 02 10:54:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-a7f922bf-dba1-404d-89f3-13ef45e02a9e tempest-TestShelveInstance-1326132134 None] Acquiring lock "cinder-6e163ee2-32e0-427d-b5b3-90347a892262-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-a7f922bf-dba1-404d-89f3-13ef45e02a9e tempest-TestShelveInstance-1326132134 None] Lock "cinder-6e163ee2-32e0-427d-b5b3-90347a892262-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-a7f922bf-dba1-404d-89f3-13ef45e02a9e tempest-TestShelveInstance-1326132134 None] Acquiring lock "cinder-quobyte-6e163ee2-32e0-427d-b5b3-90347a892262" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-a7f922bf-dba1-404d-89f3-13ef45e02a9e tempest-TestShelveInstance-1326132134 None] Lock "cinder-quobyte-6e163ee2-32e0-427d-b5b3-90347a892262" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a42f3d-6795-4bc4-8250-efdd2e54452c]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-a7f922bf-dba1-404d-89f3-13ef45e02a9e tempest-TestShelveInstance-1326132134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6e163ee2-32e0-427d-b5b3-90347a892262 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7c0eba70-3bf7-4d8e-839e-2f0a34f09921 tempest-ProjectReaderTests-1619730515 None] Acquiring lock "cinder-4e5a0f20-c982-4e1e-b491-199ae1a9942b-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7c0eba70-3bf7-4d8e-839e-2f0a34f09921 tempest-ProjectReaderTests-1619730515 None] Lock "cinder-4e5a0f20-c982-4e1e-b491-199ae1a9942b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:42 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6e163ee2-32e0-427d-b5b3-90347a892262 Nov 02 10:54:42 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7c0eba70-3bf7-4d8e-839e-2f0a34f09921 tempest-ProjectReaderTests-1619730515 None] Acquiring lock "cinder-quobyte-4e5a0f20-c982-4e1e-b491-199ae1a9942b" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7c0eba70-3bf7-4d8e-839e-2f0a34f09921 tempest-ProjectReaderTests-1619730515 None] Lock "cinder-quobyte-4e5a0f20-c982-4e1e-b491-199ae1a9942b" acquired by "delete_volume" :: waited 0.036s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e84609c-5a95-47ad-b2a7-efdf2902ee9b]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c0eba70-3bf7-4d8e-839e-2f0a34f09921 tempest-ProjectReaderTests-1619730515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5a0f20-c982-4e1e-b491-199ae1a9942b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:42 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5a0f20-c982-4e1e-b491-199ae1a9942b Nov 02 10:54:42 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:42 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-a7f922bf-dba1-404d-89f3-13ef45e02a9e tempest-TestShelveInstance-1326132134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6e163ee2-32e0-427d-b5b3-90347a892262" returned: 0 in 0.509s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-a7f922bf-dba1-404d-89f3-13ef45e02a9e tempest-TestShelveInstance-1326132134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6e163ee2-32e0-427d-b5b3-90347a892262 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:42 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6e163ee2-32e0-427d-b5b3-90347a892262 Nov 02 10:54:42 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Flow 'volume_create_manager' (8f47c751-a304-4a10-9bd4-2bd4a140617b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c91d548-24e9-4ead-9cd8-9098ea777ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c91d548-24e9-4ead-9cd8-9098ea777ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1638110049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78815e14-df40-4133-824a-62c9052b42bc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='704e563a42ec4b178c50688e3450da4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:43Z,use_quota=True,user_id='44ce5d572a0e4f438648b65e6654de77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24731b2-32be-4ee7-8535-cae260191e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24731b2-32be-4ee7-8535-cae260191e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d647f9e4-7700-4546-aa2b-ee5210c04f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:42 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d647f9e4-7700-4546-aa2b-ee5210c04f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78815e14-df40-4133-824a-62c9052b42bc', 'volume_name': 'volume-78815e14-df40-4133-824a-62c9052b42bc', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f8cd99-8ff8-4b97-a060-ef23780020c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f8cd99-8ff8-4b97-a060-ef23780020c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af81420-f042-488d-8f1e-db5cd5ee8f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:42 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Volume 78815e14-df40-4133-824a-62c9052b42bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78815e14-df40-4133-824a-62c9052b42bc', 'volume_size': 1} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1638110049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78815e14-df40-4133-824a-62c9052b42bc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='704e563a42ec4b178c50688e3450da4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:43Z,use_quota=True,user_id='44ce5d572a0e4f438648b65e6654de77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Creating volume 78815e14-df40-4133-824a-62c9052b42bc {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:42 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-78815e14-df40-4133-824a-62c9052b42bc 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c0eba70-3bf7-4d8e-839e-2f0a34f09921 tempest-ProjectReaderTests-1619730515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5a0f20-c982-4e1e-b491-199ae1a9942b" returned: 0 in 0.555s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c0eba70-3bf7-4d8e-839e-2f0a34f09921 tempest-ProjectReaderTests-1619730515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5a0f20-c982-4e1e-b491-199ae1a9942b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:42 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-a7f922bf-dba1-404d-89f3-13ef45e02a9e tempest-TestShelveInstance-1326132134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6e163ee2-32e0-427d-b5b3-90347a892262" returned: 0 in 0.300s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:42 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-78815e14-df40-4133-824a-62c9052b42bc 1073741824 Nov 02 10:54:42 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:42 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5a0f20-c982-4e1e-b491-199ae1a9942b Nov 02 10:54:42 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-a7f922bf-dba1-404d-89f3-13ef45e02a9e tempest-TestShelveInstance-1326132134 None] Lock "cinder-quobyte-6e163ee2-32e0-427d-b5b3-90347a892262" released by "delete_volume" :: held 0.886s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:42 devstack cinder-volume[87084]: DEBUG cinder.quota [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-a7f922bf-dba1-404d-89f3-13ef45e02a9e tempest-TestShelveInstance-1326132134 None] Created reservations ['6aee5ef6-64c1-4502-9e77-5d37a1a10bf4', 'aa2e63dd-627e-4fc5-9423-197ba43617a1', '3539ff02-fea0-4f1c-abf4-b6e5ebdb82ad', '558451fc-52f8-41b1-a8bd-f25c7316f253'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-a7f922bf-dba1-404d-89f3-13ef45e02a9e tempest-TestShelveInstance-1326132134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-a7f922bf-dba1-404d-89f3-13ef45e02a9e tempest-TestShelveInstance-1326132134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-a7f922bf-dba1-404d-89f3-13ef45e02a9e tempest-TestShelveInstance-1326132134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-a7f922bf-dba1-404d-89f3-13ef45e02a9e tempest-TestShelveInstance-1326132134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-a7f922bf-dba1-404d-89f3-13ef45e02a9e tempest-TestShelveInstance-1326132134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-a7f922bf-dba1-404d-89f3-13ef45e02a9e tempest-TestShelveInstance-1326132134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:43 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:54:43 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:43 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c0eba70-3bf7-4d8e-839e-2f0a34f09921 tempest-ProjectReaderTests-1619730515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4e5a0f20-c982-4e1e-b491-199ae1a9942b" returned: 0 in 0.285s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7c0eba70-3bf7-4d8e-839e-2f0a34f09921 tempest-ProjectReaderTests-1619730515 None] Lock "cinder-quobyte-4e5a0f20-c982-4e1e-b491-199ae1a9942b" released by "delete_volume" :: held 0.903s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-7c0eba70-3bf7-4d8e-839e-2f0a34f09921 tempest-ProjectReaderTests-1619730515 None] Created reservations ['73660c8f-0676-42f7-b244-ccf2b4c78628', '5f3a095c-186b-4976-a6a2-cee522a33679', '2b2dc7c5-3859-4a89-a594-6c1bf7ceb5f8', '75e016b9-49b8-4fe5-a5e3-ea36f0b014b2'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7c0eba70-3bf7-4d8e-839e-2f0a34f09921 tempest-ProjectReaderTests-1619730515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7c0eba70-3bf7-4d8e-839e-2f0a34f09921 tempest-ProjectReaderTests-1619730515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7c0eba70-3bf7-4d8e-839e-2f0a34f09921 tempest-ProjectReaderTests-1619730515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7c0eba70-3bf7-4d8e-839e-2f0a34f09921 tempest-ProjectReaderTests-1619730515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7c0eba70-3bf7-4d8e-839e-2f0a34f09921 tempest-ProjectReaderTests-1619730515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c0eba70-3bf7-4d8e-839e-2f0a34f09921 tempest-ProjectReaderTests-1619730515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:43 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:54:43 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:43 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-a7f922bf-dba1-404d-89f3-13ef45e02a9e tempest-TestShelveInstance-1326132134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.288s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG cinder.manager [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-a7f922bf-dba1-404d-89f3-13ef45e02a9e tempest-TestShelveInstance-1326132134 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-a7f922bf-dba1-404d-89f3-13ef45e02a9e tempest-TestShelveInstance-1326132134 None] Deleted volume successfully. Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-9d7fc18d-7e60-4f51-9750-5689ba9f0041 req-a7f922bf-dba1-404d-89f3-13ef45e02a9e tempest-TestShelveInstance-1326132134 None] Lock "cinder-6e163ee2-32e0-427d-b5b3-90347a892262-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:43 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-78815e14-df40-4133-824a-62c9052b42bc 1073741824" returned: 0 in 0.563s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-78815e14-df40-4133-824a-62c9052b42bc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:43 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-78815e14-df40-4133-824a-62c9052b42bc Nov 02 10:54:43 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:43 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c0eba70-3bf7-4d8e-839e-2f0a34f09921 tempest-ProjectReaderTests-1619730515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.262s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-7c0eba70-3bf7-4d8e-839e-2f0a34f09921 tempest-ProjectReaderTests-1619730515 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7c0eba70-3bf7-4d8e-839e-2f0a34f09921 tempest-ProjectReaderTests-1619730515 None] Deleted volume successfully. Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7c0eba70-3bf7-4d8e-839e-2f0a34f09921 tempest-ProjectReaderTests-1619730515 None] Lock "cinder-4e5a0f20-c982-4e1e-b491-199ae1a9942b-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:43 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-78815e14-df40-4133-824a-62c9052b42bc" returned: 0 in 0.266s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af81420-f042-488d-8f1e-db5cd5ee8f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78815e14-df40-4133-824a-62c9052b42bc', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0732031-32f7-4f01-a2ab-bb5533631080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:43 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Volume volume-78815e14-df40-4133-824a-62c9052b42bc (78815e14-df40-4133-824a-62c9052b42bc): created successfully Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0732031-32f7-4f01-a2ab-bb5533631080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Flow 'volume_create_manager' (8f47c751-a304-4a10-9bd4-2bd4a140617b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7d4977db-3f9f-420f-8918-36ac5a1e63c7 tempest-VolumesListTestJSON-1311865080 None] Created volume successfully. Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Flow 'volume_create_manager' (831f0b8f-4949-48a8-9450-2c1be2717679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd08e2d8-694b-48a5-aecc-cf0a21f891a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd08e2d8-694b-48a5-aecc-cf0a21f891a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-334758457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a55d04ed9414d7d993b5992fe983184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:45Z,use_quota=True,user_id='60094ddd1d9042879d7e473ac2d77316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cfebedc-25ca-47fd-a8d0-081552d1f6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cfebedc-25ca-47fd-a8d0-081552d1f6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e816d1ab-0cc3-4ef3-85cc-53b55960b6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e816d1ab-0cc3-4ef3-85cc-53b55960b6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f', 'volume_name': 'volume-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6309968-7757-46a3-99a2-03629fb2500a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6309968-7757-46a3-99a2-03629fb2500a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aaa8853-68f9-4461-a37a-cf085021f6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:44 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Volume 67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f', 'volume_size': 1} Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-334758457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a55d04ed9414d7d993b5992fe983184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:45Z,use_quota=True,user_id='60094ddd1d9042879d7e473ac2d77316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Creating volume 67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:44 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:54:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:44 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f 1073741824 Nov 02 10:54:44 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:45 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f 1073741824" returned: 0 in 0.488s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:45 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f Nov 02 10:54:45 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:45 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f" returned: 0 in 0.293s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aaa8853-68f9-4461-a37a-cf085021f6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb48360-5cd7-4572-afaa-202b6752eaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:45 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Volume volume-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f (67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f): created successfully Nov 02 10:54:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb48360-5cd7-4572-afaa-202b6752eaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Flow 'volume_create_manager' (831f0b8f-4949-48a8-9450-2c1be2717679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f300ab35-ee1f-4b33-baee-67f07cbfda3c tempest-ProjectReaderTests-1619730515 None] Created volume successfully. Nov 02 10:54:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42b169d5-edb8-4a70-8d97-47cdf17da95b tempest-ProjectReaderTests-1619730515 None] Acquiring lock "cinder-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42b169d5-edb8-4a70-8d97-47cdf17da95b tempest-ProjectReaderTests-1619730515 None] Lock "cinder-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42b169d5-edb8-4a70-8d97-47cdf17da95b tempest-ProjectReaderTests-1619730515 None] Acquiring lock "cinder-quobyte-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42b169d5-edb8-4a70-8d97-47cdf17da95b tempest-ProjectReaderTests-1619730515 None] Lock "cinder-quobyte-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f" acquired by "delete_volume" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:47 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0012953-be96-4b3e-bea1-06fb4836c9f0]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42b169d5-edb8-4a70-8d97-47cdf17da95b tempest-ProjectReaderTests-1619730515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-46180478-003a-4d49-b639-1518dce1b7bc tempest-VolumesListTestJSON-1311865080 None] Acquiring lock "cinder-78815e14-df40-4133-824a-62c9052b42bc-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-46180478-003a-4d49-b639-1518dce1b7bc tempest-VolumesListTestJSON-1311865080 None] Lock "cinder-78815e14-df40-4133-824a-62c9052b42bc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-46180478-003a-4d49-b639-1518dce1b7bc tempest-VolumesListTestJSON-1311865080 None] Acquiring lock "cinder-quobyte-78815e14-df40-4133-824a-62c9052b42bc" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-46180478-003a-4d49-b639-1518dce1b7bc tempest-VolumesListTestJSON-1311865080 None] Lock "cinder-quobyte-78815e14-df40-4133-824a-62c9052b42bc" acquired by "delete_volume" :: waited 0.013s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:47 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f Nov 02 10:54:47 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:47 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a39f60c-0766-4620-bac3-ae768020c4bc]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-46180478-003a-4d49-b639-1518dce1b7bc tempest-VolumesListTestJSON-1311865080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-78815e14-df40-4133-824a-62c9052b42bc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:47 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-78815e14-df40-4133-824a-62c9052b42bc Nov 02 10:54:47 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:47 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42b169d5-edb8-4a70-8d97-47cdf17da95b tempest-ProjectReaderTests-1619730515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f" returned: 0 in 0.424s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42b169d5-edb8-4a70-8d97-47cdf17da95b tempest-ProjectReaderTests-1619730515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:47 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f Nov 02 10:54:47 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:47 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-46180478-003a-4d49-b639-1518dce1b7bc tempest-VolumesListTestJSON-1311865080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-78815e14-df40-4133-824a-62c9052b42bc" returned: 0 in 0.548s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-46180478-003a-4d49-b639-1518dce1b7bc tempest-VolumesListTestJSON-1311865080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-78815e14-df40-4133-824a-62c9052b42bc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:47 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-78815e14-df40-4133-824a-62c9052b42bc Nov 02 10:54:47 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:47 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42b169d5-edb8-4a70-8d97-47cdf17da95b tempest-ProjectReaderTests-1619730515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f" returned: 0 in 0.370s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42b169d5-edb8-4a70-8d97-47cdf17da95b tempest-ProjectReaderTests-1619730515 None] Lock "cinder-quobyte-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f" released by "delete_volume" :: held 0.848s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:47 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-42b169d5-edb8-4a70-8d97-47cdf17da95b tempest-ProjectReaderTests-1619730515 None] Created reservations ['50bddc52-9bea-4e7b-b2ae-e70ff97d7e22', '9377adaa-7ff7-46cb-8684-7355da4b7a72', '922e2a69-4586-4d17-9c3a-2a160bb6d998', 'e81267be-df2c-43d7-bfc2-d22efc80552d'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:48 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-46180478-003a-4d49-b639-1518dce1b7bc tempest-VolumesListTestJSON-1311865080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-78815e14-df40-4133-824a-62c9052b42bc" returned: 0 in 0.279s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-42b169d5-edb8-4a70-8d97-47cdf17da95b tempest-ProjectReaderTests-1619730515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-42b169d5-edb8-4a70-8d97-47cdf17da95b tempest-ProjectReaderTests-1619730515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-42b169d5-edb8-4a70-8d97-47cdf17da95b tempest-ProjectReaderTests-1619730515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-42b169d5-edb8-4a70-8d97-47cdf17da95b tempest-ProjectReaderTests-1619730515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-42b169d5-edb8-4a70-8d97-47cdf17da95b tempest-ProjectReaderTests-1619730515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42b169d5-edb8-4a70-8d97-47cdf17da95b tempest-ProjectReaderTests-1619730515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-46180478-003a-4d49-b639-1518dce1b7bc tempest-VolumesListTestJSON-1311865080 None] Lock "cinder-quobyte-78815e14-df40-4133-824a-62c9052b42bc" released by "delete_volume" :: held 0.888s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:48 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:54:48 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-46180478-003a-4d49-b639-1518dce1b7bc tempest-VolumesListTestJSON-1311865080 None] Created reservations ['3863473a-4c18-486e-a358-0b2333955b32', '1d294286-449d-4291-b146-73102bb848a9', 'bee07dc8-bd2b-4b0e-b78e-1d2f71874cc4', 'd982586f-7649-4d6d-9732-b4facc637025'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-46180478-003a-4d49-b639-1518dce1b7bc tempest-VolumesListTestJSON-1311865080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-46180478-003a-4d49-b639-1518dce1b7bc tempest-VolumesListTestJSON-1311865080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-46180478-003a-4d49-b639-1518dce1b7bc tempest-VolumesListTestJSON-1311865080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-46180478-003a-4d49-b639-1518dce1b7bc tempest-VolumesListTestJSON-1311865080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-46180478-003a-4d49-b639-1518dce1b7bc tempest-VolumesListTestJSON-1311865080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-46180478-003a-4d49-b639-1518dce1b7bc tempest-VolumesListTestJSON-1311865080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:48 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:54:48 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:48 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42b169d5-edb8-4a70-8d97-47cdf17da95b tempest-ProjectReaderTests-1619730515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.344s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-42b169d5-edb8-4a70-8d97-47cdf17da95b tempest-ProjectReaderTests-1619730515 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e0de4f33-16f8-4d57-893e-0d123a065be6 tempest-VolumesListTestJSON-1311865080 None] Acquiring lock "cinder-eb2203d7-02f1-42f3-ae58-20f178271c45-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-42b169d5-edb8-4a70-8d97-47cdf17da95b tempest-ProjectReaderTests-1619730515 None] Deleted volume successfully. Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42b169d5-edb8-4a70-8d97-47cdf17da95b tempest-ProjectReaderTests-1619730515 None] Lock "cinder-67f090e4-0f0a-4e0d-8a1a-efb96bf80b9f-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e0de4f33-16f8-4d57-893e-0d123a065be6 tempest-VolumesListTestJSON-1311865080 None] Lock "cinder-eb2203d7-02f1-42f3-ae58-20f178271c45-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e0de4f33-16f8-4d57-893e-0d123a065be6 tempest-VolumesListTestJSON-1311865080 None] Acquiring lock "cinder-quobyte-eb2203d7-02f1-42f3-ae58-20f178271c45" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e0de4f33-16f8-4d57-893e-0d123a065be6 tempest-VolumesListTestJSON-1311865080 None] Lock "cinder-quobyte-eb2203d7-02f1-42f3-ae58-20f178271c45" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3e136a-a881-498b-94d7-cab91d95f689]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0de4f33-16f8-4d57-893e-0d123a065be6 tempest-VolumesListTestJSON-1311865080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-eb2203d7-02f1-42f3-ae58-20f178271c45 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:48 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-46180478-003a-4d49-b639-1518dce1b7bc tempest-VolumesListTestJSON-1311865080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.385s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-46180478-003a-4d49-b639-1518dce1b7bc tempest-VolumesListTestJSON-1311865080 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-46180478-003a-4d49-b639-1518dce1b7bc tempest-VolumesListTestJSON-1311865080 None] Deleted volume successfully. Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-46180478-003a-4d49-b639-1518dce1b7bc tempest-VolumesListTestJSON-1311865080 None] Lock "cinder-78815e14-df40-4133-824a-62c9052b42bc-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:48 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-eb2203d7-02f1-42f3-ae58-20f178271c45 Nov 02 10:54:48 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Flow 'volume_create_manager' (7d0f3c32-fbbc-43b0-859b-e30bc3da0018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1558cf61-3da8-4701-822e-bef8eef25606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1558cf61-3da8-4701-822e-bef8eef25606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-831292735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5099ae86-8a18-40e5-a503-2a2c4cb2f5f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a55d04ed9414d7d993b5992fe983184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:49Z,use_quota=True,user_id='60094ddd1d9042879d7e473ac2d77316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2287c2-2966-424d-9e4b-34a4d7e62bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2287c2-2966-424d-9e4b-34a4d7e62bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e6905b-5490-4f31-a58b-a4aea329ac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e6905b-5490-4f31-a58b-a4aea329ac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5099ae86-8a18-40e5-a503-2a2c4cb2f5f7', 'volume_name': 'volume-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50abec8d-f38b-47dd-82be-60b574cdf937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50abec8d-f38b-47dd-82be-60b574cdf937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3182866-2b57-42c9-ab9d-996c42df437f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:48 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Volume 5099ae86-8a18-40e5-a503-2a2c4cb2f5f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7', 'volume_size': 1} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-831292735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5099ae86-8a18-40e5-a503-2a2c4cb2f5f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a55d04ed9414d7d993b5992fe983184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:49Z,use_quota=True,user_id='60094ddd1d9042879d7e473ac2d77316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Creating volume 5099ae86-8a18-40e5-a503-2a2c4cb2f5f7 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:48 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:54:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:49 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7 1073741824 Nov 02 10:54:49 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:49 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0de4f33-16f8-4d57-893e-0d123a065be6 tempest-VolumesListTestJSON-1311865080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-eb2203d7-02f1-42f3-ae58-20f178271c45" returned: 0 in 0.485s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0de4f33-16f8-4d57-893e-0d123a065be6 tempest-VolumesListTestJSON-1311865080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-eb2203d7-02f1-42f3-ae58-20f178271c45 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:49 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-eb2203d7-02f1-42f3-ae58-20f178271c45 Nov 02 10:54:49 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:49 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0de4f33-16f8-4d57-893e-0d123a065be6 tempest-VolumesListTestJSON-1311865080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-eb2203d7-02f1-42f3-ae58-20f178271c45" returned: 0 in 0.263s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e0de4f33-16f8-4d57-893e-0d123a065be6 tempest-VolumesListTestJSON-1311865080 None] Lock "cinder-quobyte-eb2203d7-02f1-42f3-ae58-20f178271c45" released by "delete_volume" :: held 0.811s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-e0de4f33-16f8-4d57-893e-0d123a065be6 tempest-VolumesListTestJSON-1311865080 None] Created reservations ['394df491-4b06-4284-b866-f5f86ee59894', '018aca87-8089-4e26-9698-3524578b97fa', '16245b5d-1934-4b11-8860-44f0821757d7', 'e353c5b2-b346-4b81-94f2-74219432a376'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:49 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7 1073741824" returned: 0 in 0.483s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e0de4f33-16f8-4d57-893e-0d123a065be6 tempest-VolumesListTestJSON-1311865080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e0de4f33-16f8-4d57-893e-0d123a065be6 tempest-VolumesListTestJSON-1311865080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e0de4f33-16f8-4d57-893e-0d123a065be6 tempest-VolumesListTestJSON-1311865080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e0de4f33-16f8-4d57-893e-0d123a065be6 tempest-VolumesListTestJSON-1311865080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e0de4f33-16f8-4d57-893e-0d123a065be6 tempest-VolumesListTestJSON-1311865080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0de4f33-16f8-4d57-893e-0d123a065be6 tempest-VolumesListTestJSON-1311865080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:49 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:54:49 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:49 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7 Nov 02 10:54:49 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0f1979e8-8f26-4f51-8aa6-e4c538f57bff tempest-VolumesListTestJSON-1311865080 None] Acquiring lock "cinder-2065a423-9856-4279-9c7b-81dbc5305e2c-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:49 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0f1979e8-8f26-4f51-8aa6-e4c538f57bff tempest-VolumesListTestJSON-1311865080 None] Lock "cinder-2065a423-9856-4279-9c7b-81dbc5305e2c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0de4f33-16f8-4d57-893e-0d123a065be6 tempest-VolumesListTestJSON-1311865080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.337s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-e0de4f33-16f8-4d57-893e-0d123a065be6 tempest-VolumesListTestJSON-1311865080 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e0de4f33-16f8-4d57-893e-0d123a065be6 tempest-VolumesListTestJSON-1311865080 None] Deleted volume successfully. Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e0de4f33-16f8-4d57-893e-0d123a065be6 tempest-VolumesListTestJSON-1311865080 None] Lock "cinder-eb2203d7-02f1-42f3-ae58-20f178271c45-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0f1979e8-8f26-4f51-8aa6-e4c538f57bff tempest-VolumesListTestJSON-1311865080 None] Acquiring lock "cinder-quobyte-2065a423-9856-4279-9c7b-81dbc5305e2c" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0f1979e8-8f26-4f51-8aa6-e4c538f57bff tempest-VolumesListTestJSON-1311865080 None] Lock "cinder-quobyte-2065a423-9856-4279-9c7b-81dbc5305e2c" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:49 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7" returned: 0 in 0.429s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3182866-2b57-42c9-ab9d-996c42df437f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f90ad15-f10f-4768-853e-08f0908f7066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cba082-307f-423b-b03d-5d7e3ec87a75]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0f1979e8-8f26-4f51-8aa6-e4c538f57bff tempest-VolumesListTestJSON-1311865080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2065a423-9856-4279-9c7b-81dbc5305e2c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:50 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Volume volume-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7 (5099ae86-8a18-40e5-a503-2a2c4cb2f5f7): created successfully Nov 02 10:54:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f90ad15-f10f-4768-853e-08f0908f7066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Flow 'volume_create_manager' (7d0f3c32-fbbc-43b0-859b-e30bc3da0018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:50 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-eb3d7f8c-e422-447d-b342-41ac24a49f72 tempest-ProjectReaderTests-1619730515 None] Created volume successfully. Nov 02 10:54:50 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2065a423-9856-4279-9c7b-81dbc5305e2c Nov 02 10:54:50 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:50 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0f1979e8-8f26-4f51-8aa6-e4c538f57bff tempest-VolumesListTestJSON-1311865080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2065a423-9856-4279-9c7b-81dbc5305e2c" returned: 0 in 0.372s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0f1979e8-8f26-4f51-8aa6-e4c538f57bff tempest-VolumesListTestJSON-1311865080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2065a423-9856-4279-9c7b-81dbc5305e2c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:50 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2065a423-9856-4279-9c7b-81dbc5305e2c Nov 02 10:54:50 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:50 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0f1979e8-8f26-4f51-8aa6-e4c538f57bff tempest-VolumesListTestJSON-1311865080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2065a423-9856-4279-9c7b-81dbc5305e2c" returned: 0 in 0.275s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0f1979e8-8f26-4f51-8aa6-e4c538f57bff tempest-VolumesListTestJSON-1311865080 None] Lock "cinder-quobyte-2065a423-9856-4279-9c7b-81dbc5305e2c" released by "delete_volume" :: held 0.704s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:50 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-0f1979e8-8f26-4f51-8aa6-e4c538f57bff tempest-VolumesListTestJSON-1311865080 None] Created reservations ['ca36288d-0016-406c-a0f0-23b9fc33439e', 'dc460b81-82ce-4e60-a9ff-e05d34827abd', '7a05411e-1abe-437d-8ee9-d19f9f8ece53', '7b3830fb-4bc6-49bb-84b9-97a61280c18c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0f1979e8-8f26-4f51-8aa6-e4c538f57bff tempest-VolumesListTestJSON-1311865080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0f1979e8-8f26-4f51-8aa6-e4c538f57bff tempest-VolumesListTestJSON-1311865080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0f1979e8-8f26-4f51-8aa6-e4c538f57bff tempest-VolumesListTestJSON-1311865080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0f1979e8-8f26-4f51-8aa6-e4c538f57bff tempest-VolumesListTestJSON-1311865080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0f1979e8-8f26-4f51-8aa6-e4c538f57bff tempest-VolumesListTestJSON-1311865080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0f1979e8-8f26-4f51-8aa6-e4c538f57bff tempest-VolumesListTestJSON-1311865080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:50 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:54:50 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63e8844a-cd6b-42f3-9041-4d3b59ea9844 tempest-ProjectReaderTests-1619730515 None] Acquiring lock "cinder-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63e8844a-cd6b-42f3-9041-4d3b59ea9844 tempest-ProjectReaderTests-1619730515 None] Lock "cinder-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63e8844a-cd6b-42f3-9041-4d3b59ea9844 tempest-ProjectReaderTests-1619730515 None] Acquiring lock "cinder-quobyte-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63e8844a-cd6b-42f3-9041-4d3b59ea9844 tempest-ProjectReaderTests-1619730515 None] Lock "cinder-quobyte-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7" acquired by "delete_volume" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:51 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0f1979e8-8f26-4f51-8aa6-e4c538f57bff tempest-VolumesListTestJSON-1311865080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.356s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:51 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-0f1979e8-8f26-4f51-8aa6-e4c538f57bff tempest-VolumesListTestJSON-1311865080 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:51 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0f1979e8-8f26-4f51-8aa6-e4c538f57bff tempest-VolumesListTestJSON-1311865080 None] Deleted volume successfully. Nov 02 10:54:51 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5f1ec4-7a56-4f99-bee4-2666b52bdc09]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-63e8844a-cd6b-42f3-9041-4d3b59ea9844 tempest-ProjectReaderTests-1619730515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0f1979e8-8f26-4f51-8aa6-e4c538f57bff tempest-VolumesListTestJSON-1311865080 None] Lock "cinder-2065a423-9856-4279-9c7b-81dbc5305e2c-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:51 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7 Nov 02 10:54:51 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:51 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-63e8844a-cd6b-42f3-9041-4d3b59ea9844 tempest-ProjectReaderTests-1619730515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7" returned: 0 in 0.402s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-63e8844a-cd6b-42f3-9041-4d3b59ea9844 tempest-ProjectReaderTests-1619730515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:51 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7 Nov 02 10:54:51 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:51 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-63e8844a-cd6b-42f3-9041-4d3b59ea9844 tempest-ProjectReaderTests-1619730515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7" returned: 0 in 0.293s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63e8844a-cd6b-42f3-9041-4d3b59ea9844 tempest-ProjectReaderTests-1619730515 None] Lock "cinder-quobyte-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7" released by "delete_volume" :: held 0.753s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:51 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-63e8844a-cd6b-42f3-9041-4d3b59ea9844 tempest-ProjectReaderTests-1619730515 None] Created reservations ['289f92d1-c891-4918-8c3e-3b988734a0e8', 'bdb3722f-1f65-4c48-b5d7-029e1966ef49', 'e0ef5720-0d9e-42eb-80e7-49947134bb5e', '12745f5f-24c5-468d-9afb-8cc96b4e700a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-63e8844a-cd6b-42f3-9041-4d3b59ea9844 tempest-ProjectReaderTests-1619730515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-63e8844a-cd6b-42f3-9041-4d3b59ea9844 tempest-ProjectReaderTests-1619730515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-63e8844a-cd6b-42f3-9041-4d3b59ea9844 tempest-ProjectReaderTests-1619730515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-63e8844a-cd6b-42f3-9041-4d3b59ea9844 tempest-ProjectReaderTests-1619730515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-63e8844a-cd6b-42f3-9041-4d3b59ea9844 tempest-ProjectReaderTests-1619730515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-63e8844a-cd6b-42f3-9041-4d3b59ea9844 tempest-ProjectReaderTests-1619730515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:52 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:54:52 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:52 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-63e8844a-cd6b-42f3-9041-4d3b59ea9844 tempest-ProjectReaderTests-1619730515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.310s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:52 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-63e8844a-cd6b-42f3-9041-4d3b59ea9844 tempest-ProjectReaderTests-1619730515 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:52 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-63e8844a-cd6b-42f3-9041-4d3b59ea9844 tempest-ProjectReaderTests-1619730515 None] Deleted volume successfully. Nov 02 10:54:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63e8844a-cd6b-42f3-9041-4d3b59ea9844 tempest-ProjectReaderTests-1619730515 None] Lock "cinder-5099ae86-8a18-40e5-a503-2a2c4cb2f5f7-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:54:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:53 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:54:53 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:53 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.306s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:54:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:54:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:54:55 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Flow 'volume_create_manager' (88846a58-54ba-445e-a9a6-2ef7fe81ec48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4871865-312a-47b0-826f-5ade83263d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4871865-312a-47b0-826f-5ade83263d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1933927713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e77aafb-223b-4095-9c5a-1d8c965a299b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8389130ec6641f0bf249db5110fc0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:56Z,use_quota=True,user_id='69a817767db047c48e8be5a6fa5a26c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f24660e-e1d3-4370-ac0e-927f174979cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f24660e-e1d3-4370-ac0e-927f174979cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1896cec8-2ca3-4f2b-bed2-4d74ffcc4e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1896cec8-2ca3-4f2b-bed2-4d74ffcc4e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e77aafb-223b-4095-9c5a-1d8c965a299b', 'volume_name': 'volume-1e77aafb-223b-4095-9c5a-1d8c965a299b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0818b58c-e075-4313-abe1-9fbd6fbbe919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0818b58c-e075-4313-abe1-9fbd6fbbe919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e3c609-8845-4c07-ab1f-7ba7593d46fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:56 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Volume 1e77aafb-223b-4095-9c5a-1d8c965a299b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e77aafb-223b-4095-9c5a-1d8c965a299b', 'volume_size': 1} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1933927713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e77aafb-223b-4095-9c5a-1d8c965a299b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8389130ec6641f0bf249db5110fc0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:56Z,use_quota=True,user_id='69a817767db047c48e8be5a6fa5a26c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Creating volume 1e77aafb-223b-4095-9c5a-1d8c965a299b {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:56 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1e77aafb-223b-4095-9c5a-1d8c965a299b 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:56 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1e77aafb-223b-4095-9c5a-1d8c965a299b 1073741824 Nov 02 10:54:56 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:56 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1e77aafb-223b-4095-9c5a-1d8c965a299b 1073741824" returned: 0 in 0.521s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1e77aafb-223b-4095-9c5a-1d8c965a299b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:56 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1e77aafb-223b-4095-9c5a-1d8c965a299b Nov 02 10:54:56 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:56 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1e77aafb-223b-4095-9c5a-1d8c965a299b" returned: 0 in 0.325s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e3c609-8845-4c07-ab1f-7ba7593d46fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e77aafb-223b-4095-9c5a-1d8c965a299b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd4020b-254c-4667-aad2-fb37724b9441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:57 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Volume volume-1e77aafb-223b-4095-9c5a-1d8c965a299b (1e77aafb-223b-4095-9c5a-1d8c965a299b): created successfully Nov 02 10:54:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd4020b-254c-4667-aad2-fb37724b9441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Flow 'volume_create_manager' (88846a58-54ba-445e-a9a6-2ef7fe81ec48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f51567ed-ee61-44c3-add2-bcab659b6d0d tempest-VolumesNegativeTest-1048167414 None] Created volume successfully. Nov 02 10:55:07 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=47,cinder:INSERT=23,cinder:UPDATE=66,cinder:DELETE=9 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:55:07 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=99,cinder:DELETE=6,cinder:SELECT=58,cinder:INSERT=15 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Flow 'volume_create_manager' (786febd5-103d-411a-a462-4275ee76f0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b322d47-1542-4ebe-9cb8-187e20bad686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b322d47-1542-4ebe-9cb8-187e20bad686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-777076298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d89f222-b79b-4d0e-8a7b-ba5631f9c33b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1abbd4f25c43f6acc197f6f7ce0e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:19Z,use_quota=True,user_id='6fac70e4ed724b1d9c48cacfe7be2343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3aff994-8281-41c0-863b-6cb2ce779c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3aff994-8281-41c0-863b-6cb2ce779c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edcaaf9b-7477-4b77-9742-1c418225e46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edcaaf9b-7477-4b77-9742-1c418225e46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d89f222-b79b-4d0e-8a7b-ba5631f9c33b', 'volume_name': 'volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b39924d-0fa2-4071-89f2-2e25c7e3e2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b39924d-0fa2-4071-89f2-2e25c7e3e2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952df8d6-3956-45ee-9708-2e926ed593a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:19 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Volume 2d89f222-b79b-4d0e-8a7b-ba5631f9c33b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b', 'volume_size': 1} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-777076298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d89f222-b79b-4d0e-8a7b-ba5631f9c33b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1abbd4f25c43f6acc197f6f7ce0e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:19Z,use_quota=True,user_id='6fac70e4ed724b1d9c48cacfe7be2343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Creating volume 2d89f222-b79b-4d0e-8a7b-ba5631f9c33b {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:19 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:55:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:19 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b 1073741824 Nov 02 10:55:19 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:20 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b 1073741824" returned: 0 in 0.517s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:20 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b Nov 02 10:55:20 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:20 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b" returned: 0 in 0.269s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952df8d6-3956-45ee-9708-2e926ed593a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bb1996-ec27-4e3b-968d-971b3a7c6d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:20 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Volume volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b (2d89f222-b79b-4d0e-8a7b-ba5631f9c33b): created successfully Nov 02 10:55:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bb1996-ec27-4e3b-968d-971b3a7c6d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Flow 'volume_create_manager' (786febd5-103d-411a-a462-4275ee76f0c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:20 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c2ccaa2c-f288-41ac-9400-c553a2e9cffb tempest-SnapshotDependencyTests-1756748953 None] Created volume successfully. Nov 02 10:55:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e0d3a0b8-3e71-4a2b-9c44-0584174409c0 tempest-SnapshotDependencyTests-1756748953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e0d3a0b8-3e71-4a2b-9c44-0584174409c0 tempest-SnapshotDependencyTests-1756748953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-e0d3a0b8-3e71-4a2b-9c44-0584174409c0 tempest-SnapshotDependencyTests-1756748953 None] Creating offline snapshot 0b74d970-ab09-4e3e-a824-46b219b2e0ce of volume 2d89f222-b79b-4d0e-8a7b-ba5631f9c33b {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:55:21 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cdedc6-24f6-4cf2-a274-dabad6379dab]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0d3a0b8-3e71-4a2b-9c44-0584174409c0 tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:21 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b Nov 02 10:55:21 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:22 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0d3a0b8-3e71-4a2b-9c44-0584174409c0 tempest-SnapshotDependencyTests-1756748953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b" returned: 0 in 0.366s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0d3a0b8-3e71-4a2b-9c44-0584174409c0 tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:22 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce 1G Nov 02 10:55:22 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:22 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0d3a0b8-3e71-4a2b-9c44-0584174409c0 tempest-SnapshotDependencyTests-1756748953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce 1G" returned: 0 in 0.456s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0d3a0b8-3e71-4a2b-9c44-0584174409c0 tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:22 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce Nov 02 10:55:22 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:22 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0d3a0b8-3e71-4a2b-9c44-0584174409c0 tempest-SnapshotDependencyTests-1756748953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce" returned: 0 in 0.307s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:22 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-e0d3a0b8-3e71-4a2b-9c44-0584174409c0 tempest-SnapshotDependencyTests-1756748953 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce is being set with open permissions: ugo+rw Nov 02 10:55:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0d3a0b8-3e71-4a2b-9c44-0584174409c0 tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:22 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce Nov 02 10:55:22 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:23 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0d3a0b8-3e71-4a2b-9c44-0584174409c0 tempest-SnapshotDependencyTests-1756748953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce" returned: 0 in 0.253s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0d3a0b8-3e71-4a2b-9c44-0584174409c0 tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:23 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.info Nov 02 10:55:23 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:23 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0d3a0b8-3e71-4a2b-9c44-0584174409c0 tempest-SnapshotDependencyTests-1756748953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.info" returned: 0 in 0.248s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:23 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-e0d3a0b8-3e71-4a2b-9c44-0584174409c0 tempest-SnapshotDependencyTests-1756748953 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.info is being set with open permissions: ugo+rw Nov 02 10:55:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0d3a0b8-3e71-4a2b-9c44-0584174409c0 tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:23 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.info Nov 02 10:55:23 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:23 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0d3a0b8-3e71-4a2b-9c44-0584174409c0 tempest-SnapshotDependencyTests-1756748953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.info" returned: 0 in 0.245s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e0d3a0b8-3e71-4a2b-9c44-0584174409c0 tempest-SnapshotDependencyTests-1756748953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e0d3a0b8-3e71-4a2b-9c44-0584174409c0 tempest-SnapshotDependencyTests-1756748953 None] Create snapshot completed successfully Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Flow 'volume_create_manager' (a2e918c4-5092-42eb-9372-57fc5e0e5309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eecac362-e4bb-4267-88a8-7df7383067c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eecac362-e4bb-4267-88a8-7df7383067c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8165691-4bf4-43e7-a4d2-6835297f5f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1abbd4f25c43f6acc197f6f7ce0e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0b74d970-ab09-4e3e-a824-46b219b2e0ce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:25Z,use_quota=True,user_id='6fac70e4ed724b1d9c48cacfe7be2343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3fd8b9-5a1f-4935-a3e6-a7d8791f789f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3fd8b9-5a1f-4935-a3e6-a7d8791f789f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076c9e89-4638-4a90-978f-3b49526679a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076c9e89-4638-4a90-978f-3b49526679a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b8165691-4bf4-43e7-a4d2-6835297f5f23', 'volume_name': 'volume-b8165691-4bf4-43e7-a4d2-6835297f5f23', 'volume_size': 1, 'snapshot_id': '0b74d970-ab09-4e3e-a824-46b219b2e0ce'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb378dd7-bea3-4b80-8ce9-5e5646b9d06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb378dd7-bea3-4b80-8ce9-5e5646b9d06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745b2ab3-c51a-4fac-9c1b-018cb6812fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:24 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Volume b8165691-4bf4-43e7-a4d2-6835297f5f23: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b8165691-4bf4-43e7-a4d2-6835297f5f23', 'volume_size': 1, 'snapshot_id': '0b74d970-ab09-4e3e-a824-46b219b2e0ce'} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Acquiring lock "cinder-quobyte-0b74d970-ab09-4e3e-a824-46b219b2e0ce-b8165691-4bf4-43e7-a4d2-6835297f5f23" by "_create_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Lock "cinder-quobyte-0b74d970-ab09-4e3e-a824-46b219b2e0ce-b8165691-4bf4-43e7-a4d2-6835297f5f23" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Creating volume b8165691-4bf4-43e7-a4d2-6835297f5f23 from snapshot 0b74d970-ab09-4e3e-a824-46b219b2e0ce {{(pid=87084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Acquiring lock "cinder-quobyte-b8165691-4bf4-43e7-a4d2-6835297f5f23" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Lock "cinder-quobyte-b8165691-4bf4-43e7-a4d2-6835297f5f23" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] snapshot: 0b74d970-ab09-4e3e-a824-46b219b2e0ce, volume: b8165691-4bf4-43e7-a4d2-6835297f5f23, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa70abc-ba66-4f80-b523-9d5b05774f8f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:25 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce Nov 02 10:55:25 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:25 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce" returned: 0 in 0.415s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:55:25 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5745c5-7b98-4cad-82c4-ec7835eb23de]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:25 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b Nov 02 10:55:25 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:25 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b" returned: 0 in 0.543s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:55:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:55:25 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Path /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8165691-4bf4-43e7-a4d2-6835297f5f23 not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:55:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8165691-4bf4-43e7-a4d2-6835297f5f23 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:26 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8165691-4bf4-43e7-a4d2-6835297f5f23 Nov 02 10:55:26 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:34 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=6,cinder:SELECT=8,cinder:INSERT=2 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:55:34 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:DELETE=2 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:55:35 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Flow 'volume_create_manager' (b803b36c-1c02-4e2a-863a-e85a4f1fe523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aeffd29-093c-4a71-810d-7ad96771064a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aeffd29-093c-4a71-810d-7ad96771064a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1790183549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff332aa-719f-446c-9e11-cf81cbe7594b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7818603146b74e898007fcfe2e4f0b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:35Z,use_quota=True,user_id='6c3689cdfd4c4b34a5ff63e25a98e984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8025347-505d-4f43-a681-05e2397949e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8025347-505d-4f43-a681-05e2397949e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41774e48-2a0b-424e-9b0a-9e144941774f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41774e48-2a0b-424e-9b0a-9e144941774f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aff332aa-719f-446c-9e11-cf81cbe7594b', 'volume_name': 'volume-aff332aa-719f-446c-9e11-cf81cbe7594b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6a1352-6de6-401c-aff7-0d2acfe4aa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6a1352-6de6-401c-aff7-0d2acfe4aa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82706ee1-b84e-461a-8901-60b308037a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:35 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Volume aff332aa-719f-446c-9e11-cf81cbe7594b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aff332aa-719f-446c-9e11-cf81cbe7594b', 'volume_size': 1} Nov 02 10:55:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:35 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8165691-4bf4-43e7-a4d2-6835297f5f23" returned: 0 in 9.917s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:35 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Image conversion details: src /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b, size 1024.00 MB, duration 9.92 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8165691-4bf4-43e7-a4d2-6835297f5f23 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:55:35 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Converted 1024.00 MB image at 103.25 MB/s Nov 02 10:55:35 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8165691-4bf4-43e7-a4d2-6835297f5f23 is being set with open permissions: ugo+rw Nov 02 10:55:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8165691-4bf4-43e7-a4d2-6835297f5f23 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:35 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8165691-4bf4-43e7-a4d2-6835297f5f23 Nov 02 10:55:35 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:36 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8165691-4bf4-43e7-a4d2-6835297f5f23" returned: 0 in 0.249s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Lock "cinder-quobyte-b8165691-4bf4-43e7-a4d2-6835297f5f23" released by "_copy_volume_from_snapshot" :: held 11.268s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Lock "cinder-quobyte-0b74d970-ab09-4e3e-a824-46b219b2e0ce-b8165691-4bf4-43e7-a4d2-6835297f5f23" released by "_create_volume_from_snapshot" :: held 11.350s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.370s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.858s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1790183549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff332aa-719f-446c-9e11-cf81cbe7594b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7818603146b74e898007fcfe2e4f0b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:35Z,use_quota=True,user_id='6c3689cdfd4c4b34a5ff63e25a98e984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Creating volume aff332aa-719f-446c-9e11-cf81cbe7594b {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:36 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:55:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:36 devstack sudo[103433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b 1073741824 Nov 02 10:55:36 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745b2ab3-c51a-4fac-9c1b-018cb6812fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8165691-4bf4-43e7-a4d2-6835297f5f23', 'volume_size': 1, 'snapshot_id': '0b74d970-ab09-4e3e-a824-46b219b2e0ce'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b970c558-e973-4cca-8e76-09bf3f4f1871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:36 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Volume volume-b8165691-4bf4-43e7-a4d2-6835297f5f23 (b8165691-4bf4-43e7-a4d2-6835297f5f23): created successfully Nov 02 10:55:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b970c558-e973-4cca-8e76-09bf3f4f1871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Flow 'volume_create_manager' (a2e918c4-5092-42eb-9372-57fc5e0e5309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:36 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d00cadf0-92ae-4db1-8418-3a84baa44371 tempest-SnapshotDependencyTests-1756748953 None] Created volume successfully. Nov 02 10:55:36 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b 1073741824" returned: 0 in 0.615s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:36 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b Nov 02 10:55:36 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] Acquiring lock "cinder-0b74d970-ab09-4e3e-a824-46b219b2e0ce-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] Lock "cinder-0b74d970-ab09-4e3e-a824-46b219b2e0ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] Acquiring lock "cinder-quobyte-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:37 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] Lock "cinder-quobyte-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] Acquiring lock "cinder-quobyte-0b74d970-ab09-4e3e-a824-46b219b2e0ce" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b" returned: 0 in 0.335s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82706ee1-b84e-461a-8901-60b308037a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aff332aa-719f-446c-9e11-cf81cbe7594b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3796e2b5-e1dd-4e75-9fd9-c531b1cd08fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] Lock "cinder-quobyte-0b74d970-ab09-4e3e-a824-46b219b2e0ce" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] Deleting offline snapshot 0b74d970-ab09-4e3e-a824-46b219b2e0ce of volume 2d89f222-b79b-4d0e-8a7b-ba5631f9c33b {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] snapshot_file for this snap is: volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:55:37 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Volume volume-aff332aa-719f-446c-9e11-cf81cbe7594b (aff332aa-719f-446c-9e11-cf81cbe7594b): created successfully Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3796e2b5-e1dd-4e75-9fd9-c531b1cd08fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Flow 'volume_create_manager' (b803b36c-1c02-4e2a-863a-e85a4f1fe523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[61581504-4d53-4506-98af-07a4a63a2b08]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-43e1d860-7eec-4ae6-8db8-c433a40c33cd tempest-TestStampPattern-597707380 None] Created volume successfully. Nov 02 10:55:37 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce Nov 02 10:55:37 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:37 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce" returned: 0 in 0.471s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0f245b-424b-4f05-b39b-e23c90f83a55]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:37 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b Nov 02 10:55:37 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:38 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b" returned: 0 in 0.599s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:38 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce Nov 02 10:55:38 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:38 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce" returned: 0 in 0.483s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:38 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce Nov 02 10:55:38 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:39 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b.0b74d970-ab09-4e3e-a824-46b219b2e0ce" returned: 0 in 0.310s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] Lock "cinder-quobyte-0b74d970-ab09-4e3e-a824-46b219b2e0ce" released by "_delete_snapshot" :: held 2.034s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] Lock "cinder-quobyte-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b" released by "delete_snapshot" :: held 2.084s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:39 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] Created reservations ['6ed423a6-a7a0-413d-bbb0-9fc9c6d0bdff', '9e124f5b-8e8f-485d-b86b-3ddcf49a1dc7', '9874d869-35cf-4621-858a-c66094c45509', '4aa27c20-5ac4-423b-972f-e1cb8480a696'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:39 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] Delete snapshot completed successfully. Nov 02 10:55:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-87f31cbc-abff-441e-be01-19e28479ce14 tempest-SnapshotDependencyTests-1756748953 None] Lock "cinder-0b74d970-ab09-4e3e-a824-46b219b2e0ce-delete_snapshot" released by "delete_snapshot" :: held 2.259s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5bf49aa2-ddce-4110-85b6-13356146e1e8 tempest-SnapshotDependencyTests-1756748953 None] Acquiring lock "cinder-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5bf49aa2-ddce-4110-85b6-13356146e1e8 tempest-SnapshotDependencyTests-1756748953 None] Lock "cinder-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5bf49aa2-ddce-4110-85b6-13356146e1e8 tempest-SnapshotDependencyTests-1756748953 None] Acquiring lock "cinder-quobyte-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5bf49aa2-ddce-4110-85b6-13356146e1e8 tempest-SnapshotDependencyTests-1756748953 None] Lock "cinder-quobyte-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:40 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df4cd1d-4a49-4e3d-bf6a-1ba317970271]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5bf49aa2-ddce-4110-85b6-13356146e1e8 tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:40 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b Nov 02 10:55:40 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:41 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5bf49aa2-ddce-4110-85b6-13356146e1e8 tempest-SnapshotDependencyTests-1756748953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b" returned: 0 in 0.771s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5bf49aa2-ddce-4110-85b6-13356146e1e8 tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:41 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b Nov 02 10:55:41 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:41 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5bf49aa2-ddce-4110-85b6-13356146e1e8 tempest-SnapshotDependencyTests-1756748953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b" returned: 0 in 0.619s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5bf49aa2-ddce-4110-85b6-13356146e1e8 tempest-SnapshotDependencyTests-1756748953 None] Lock "cinder-quobyte-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b" released by "delete_volume" :: held 1.484s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:42 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-5bf49aa2-ddce-4110-85b6-13356146e1e8 tempest-SnapshotDependencyTests-1756748953 None] Created reservations ['a3201dfe-4da5-47c2-bbec-72ec53143a78', 'd82375ad-39a6-4d98-808a-836a911d293e', '31951cfa-8bea-475c-8e8b-60f56c3f80e2', '86dc4b6c-aa0e-4897-84f6-6f85c6d96923'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5bf49aa2-ddce-4110-85b6-13356146e1e8 tempest-SnapshotDependencyTests-1756748953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5bf49aa2-ddce-4110-85b6-13356146e1e8 tempest-SnapshotDependencyTests-1756748953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5bf49aa2-ddce-4110-85b6-13356146e1e8 tempest-SnapshotDependencyTests-1756748953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5bf49aa2-ddce-4110-85b6-13356146e1e8 tempest-SnapshotDependencyTests-1756748953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5bf49aa2-ddce-4110-85b6-13356146e1e8 tempest-SnapshotDependencyTests-1756748953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5bf49aa2-ddce-4110-85b6-13356146e1e8 tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:42 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:55:42 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:42 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5bf49aa2-ddce-4110-85b6-13356146e1e8 tempest-SnapshotDependencyTests-1756748953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.491s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-5bf49aa2-ddce-4110-85b6-13356146e1e8 tempest-SnapshotDependencyTests-1756748953 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:42 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5bf49aa2-ddce-4110-85b6-13356146e1e8 tempest-SnapshotDependencyTests-1756748953 None] Deleted volume successfully. Nov 02 10:55:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5bf49aa2-ddce-4110-85b6-13356146e1e8 tempest-SnapshotDependencyTests-1756748953 None] Lock "cinder-2d89f222-b79b-4d0e-8a7b-ba5631f9c33b-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fd8b597d-4205-40a7-b1e1-42fe2c0b20a6 tempest-SnapshotDependencyTests-1756748953 None] Acquiring lock "cinder-b8165691-4bf4-43e7-a4d2-6835297f5f23-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fd8b597d-4205-40a7-b1e1-42fe2c0b20a6 tempest-SnapshotDependencyTests-1756748953 None] Lock "cinder-b8165691-4bf4-43e7-a4d2-6835297f5f23-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fd8b597d-4205-40a7-b1e1-42fe2c0b20a6 tempest-SnapshotDependencyTests-1756748953 None] Acquiring lock "cinder-quobyte-b8165691-4bf4-43e7-a4d2-6835297f5f23" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fd8b597d-4205-40a7-b1e1-42fe2c0b20a6 tempest-SnapshotDependencyTests-1756748953 None] Lock "cinder-quobyte-b8165691-4bf4-43e7-a4d2-6835297f5f23" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:43 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cd19c1-14a2-41a5-b62c-b753eea06362]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd8b597d-4205-40a7-b1e1-42fe2c0b20a6 tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8165691-4bf4-43e7-a4d2-6835297f5f23 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8ae95e58-3b69-4892-9975-fe1dda7a073e tempest-VolumesNegativeTest-1048167414 None] Acquiring lock "cinder-1e77aafb-223b-4095-9c5a-1d8c965a299b-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8ae95e58-3b69-4892-9975-fe1dda7a073e tempest-VolumesNegativeTest-1048167414 None] Lock "cinder-1e77aafb-223b-4095-9c5a-1d8c965a299b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8ae95e58-3b69-4892-9975-fe1dda7a073e tempest-VolumesNegativeTest-1048167414 None] Acquiring lock "cinder-quobyte-1e77aafb-223b-4095-9c5a-1d8c965a299b" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:43 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8165691-4bf4-43e7-a4d2-6835297f5f23 Nov 02 10:55:43 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8ae95e58-3b69-4892-9975-fe1dda7a073e tempest-VolumesNegativeTest-1048167414 None] Lock "cinder-quobyte-1e77aafb-223b-4095-9c5a-1d8c965a299b" acquired by "delete_volume" :: waited 0.040s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:43 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d99a782-94d3-4e83-b9e4-4dff62ea2d6f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8ae95e58-3b69-4892-9975-fe1dda7a073e tempest-VolumesNegativeTest-1048167414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1e77aafb-223b-4095-9c5a-1d8c965a299b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:43 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1e77aafb-223b-4095-9c5a-1d8c965a299b Nov 02 10:55:43 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:43 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd8b597d-4205-40a7-b1e1-42fe2c0b20a6 tempest-SnapshotDependencyTests-1756748953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8165691-4bf4-43e7-a4d2-6835297f5f23" returned: 0 in 0.536s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd8b597d-4205-40a7-b1e1-42fe2c0b20a6 tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8165691-4bf4-43e7-a4d2-6835297f5f23 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:43 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8165691-4bf4-43e7-a4d2-6835297f5f23 Nov 02 10:55:43 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:43 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8ae95e58-3b69-4892-9975-fe1dda7a073e tempest-VolumesNegativeTest-1048167414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1e77aafb-223b-4095-9c5a-1d8c965a299b" returned: 0 in 0.440s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8ae95e58-3b69-4892-9975-fe1dda7a073e tempest-VolumesNegativeTest-1048167414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1e77aafb-223b-4095-9c5a-1d8c965a299b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:43 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1e77aafb-223b-4095-9c5a-1d8c965a299b Nov 02 10:55:43 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:44 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd8b597d-4205-40a7-b1e1-42fe2c0b20a6 tempest-SnapshotDependencyTests-1756748953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b8165691-4bf4-43e7-a4d2-6835297f5f23" returned: 0 in 0.275s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fd8b597d-4205-40a7-b1e1-42fe2c0b20a6 tempest-SnapshotDependencyTests-1756748953 None] Lock "cinder-quobyte-b8165691-4bf4-43e7-a4d2-6835297f5f23" released by "delete_volume" :: held 0.895s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-fd8b597d-4205-40a7-b1e1-42fe2c0b20a6 tempest-SnapshotDependencyTests-1756748953 None] Created reservations ['cc8b0671-7032-4514-a3b2-5ba322b3d2b7', 'bd8bf203-b0a7-4917-aa4c-6e2f12048378', 'b1760c31-90ff-4cd4-af84-49699991d39e', 'd1259d37-9c3c-4351-80aa-72e2dd94ccf1'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fd8b597d-4205-40a7-b1e1-42fe2c0b20a6 tempest-SnapshotDependencyTests-1756748953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fd8b597d-4205-40a7-b1e1-42fe2c0b20a6 tempest-SnapshotDependencyTests-1756748953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fd8b597d-4205-40a7-b1e1-42fe2c0b20a6 tempest-SnapshotDependencyTests-1756748953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fd8b597d-4205-40a7-b1e1-42fe2c0b20a6 tempest-SnapshotDependencyTests-1756748953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fd8b597d-4205-40a7-b1e1-42fe2c0b20a6 tempest-SnapshotDependencyTests-1756748953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd8b597d-4205-40a7-b1e1-42fe2c0b20a6 tempest-SnapshotDependencyTests-1756748953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:44 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8ae95e58-3b69-4892-9975-fe1dda7a073e tempest-VolumesNegativeTest-1048167414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1e77aafb-223b-4095-9c5a-1d8c965a299b" returned: 0 in 0.303s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:44 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:55:44 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8ae95e58-3b69-4892-9975-fe1dda7a073e tempest-VolumesNegativeTest-1048167414 None] Lock "cinder-quobyte-1e77aafb-223b-4095-9c5a-1d8c965a299b" released by "delete_volume" :: held 0.819s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-8ae95e58-3b69-4892-9975-fe1dda7a073e tempest-VolumesNegativeTest-1048167414 None] Created reservations ['5286fd3a-1ffd-4290-9750-8f1612676bb0', 'a8533e48-c2a7-4c85-809a-1fd7080d6325', 'd47ee64c-11e3-4190-a3bb-247a80b09933', '30d5e551-bcd0-4513-8961-828a0271fcb7'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8ae95e58-3b69-4892-9975-fe1dda7a073e tempest-VolumesNegativeTest-1048167414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8ae95e58-3b69-4892-9975-fe1dda7a073e tempest-VolumesNegativeTest-1048167414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8ae95e58-3b69-4892-9975-fe1dda7a073e tempest-VolumesNegativeTest-1048167414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8ae95e58-3b69-4892-9975-fe1dda7a073e tempest-VolumesNegativeTest-1048167414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8ae95e58-3b69-4892-9975-fe1dda7a073e tempest-VolumesNegativeTest-1048167414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8ae95e58-3b69-4892-9975-fe1dda7a073e tempest-VolumesNegativeTest-1048167414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:44 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fd8b597d-4205-40a7-b1e1-42fe2c0b20a6 tempest-SnapshotDependencyTests-1756748953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.333s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-fd8b597d-4205-40a7-b1e1-42fe2c0b20a6 tempest-SnapshotDependencyTests-1756748953 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:44 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:55:44 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-fd8b597d-4205-40a7-b1e1-42fe2c0b20a6 tempest-SnapshotDependencyTests-1756748953 None] Deleted volume successfully. Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fd8b597d-4205-40a7-b1e1-42fe2c0b20a6 tempest-SnapshotDependencyTests-1756748953 None] Lock "cinder-b8165691-4bf4-43e7-a4d2-6835297f5f23-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:44 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8ae95e58-3b69-4892-9975-fe1dda7a073e tempest-VolumesNegativeTest-1048167414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.450s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:44 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-8ae95e58-3b69-4892-9975-fe1dda7a073e tempest-VolumesNegativeTest-1048167414 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8ae95e58-3b69-4892-9975-fe1dda7a073e tempest-VolumesNegativeTest-1048167414 None] Deleted volume successfully. Nov 02 10:55:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8ae95e58-3b69-4892-9975-fe1dda7a073e tempest-VolumesNegativeTest-1048167414 None] Lock "cinder-1e77aafb-223b-4095-9c5a-1d8c965a299b-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Flow 'volume_create_manager' (3a727226-bc8e-4103-bb70-868359c8a186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8fff2ef-6e53-4abd-8ded-7a70fc2cc42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8fff2ef-6e53-4abd-8ded-7a70fc2cc42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-463454495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc749d7f-19bc-46cb-8b84-4aeb398a1674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43c93f6508984df695f277bfeca10cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:50Z,use_quota=True,user_id='8a67b0cd66e242af88119e13ca4af13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58028300-5a5c-486e-aa86-9bccc95dc447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58028300-5a5c-486e-aa86-9bccc95dc447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c729f6b-037a-4895-8f6a-216b153985dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c729f6b-037a-4895-8f6a-216b153985dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc749d7f-19bc-46cb-8b84-4aeb398a1674', 'volume_name': 'volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8627c6d2-7795-4f51-b367-ed3dba190599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8627c6d2-7795-4f51-b367-ed3dba190599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8018b4b8-15d5-472b-a5fd-065ede650e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:49 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Volume bc749d7f-19bc-46cb-8b84-4aeb398a1674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674', 'volume_size': 1} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-463454495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc749d7f-19bc-46cb-8b84-4aeb398a1674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43c93f6508984df695f277bfeca10cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:50Z,use_quota=True,user_id='8a67b0cd66e242af88119e13ca4af13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Creating volume bc749d7f-19bc-46cb-8b84-4aeb398a1674 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:49 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:55:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:49 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674 1073741824 Nov 02 10:55:49 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:50 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674 1073741824" returned: 0 in 0.558s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:50 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674 Nov 02 10:55:50 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:50 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674" returned: 0 in 0.398s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:55:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8018b4b8-15d5-472b-a5fd-065ede650e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8e4690-88e6-4041-afc7-6e8946f505aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:50 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Volume volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674 (bc749d7f-19bc-46cb-8b84-4aeb398a1674): created successfully Nov 02 10:55:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8e4690-88e6-4041-afc7-6e8946f505aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Flow 'volume_create_manager' (3a727226-bc8e-4103-bb70-868359c8a186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:50 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b15a42ea-a9a4-4708-b0e0-0dc672a786db tempest-VolumesSnapshotListTestJSON-1931421725 None] Created volume successfully. Nov 02 10:55:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e639e97f-0c14-47b9-ad19-973d7f7583e4 tempest-VolumesSnapshotListTestJSON-1931421725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e639e97f-0c14-47b9-ad19-973d7f7583e4 tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-e639e97f-0c14-47b9-ad19-973d7f7583e4 tempest-VolumesSnapshotListTestJSON-1931421725 None] Creating offline snapshot af0627b5-b2a1-42a4-992a-9173dd288d4e of volume bc749d7f-19bc-46cb-8b84-4aeb398a1674 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:55:52 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78b4bea-a9dd-4464-ad28-b0b3bd44d25c]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e639e97f-0c14-47b9-ad19-973d7f7583e4 tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:52 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674 Nov 02 10:55:52 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:52 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e639e97f-0c14-47b9-ad19-973d7f7583e4 tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674" returned: 0 in 0.463s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e639e97f-0c14-47b9-ad19-973d7f7583e4 tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:52 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e 1G Nov 02 10:55:52 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:55:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:53 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e639e97f-0c14-47b9-ad19-973d7f7583e4 tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e 1G" returned: 0 in 0.459s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e639e97f-0c14-47b9-ad19-973d7f7583e4 tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:53 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:55:53 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:53 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e Nov 02 10:55:53 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:53 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.275s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:55:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:55:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:55:53 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e639e97f-0c14-47b9-ad19-973d7f7583e4 tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e" returned: 0 in 0.401s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:53 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-e639e97f-0c14-47b9-ad19-973d7f7583e4 tempest-VolumesSnapshotListTestJSON-1931421725 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e is being set with open permissions: ugo+rw Nov 02 10:55:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e639e97f-0c14-47b9-ad19-973d7f7583e4 tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:53 devstack sudo[103624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e Nov 02 10:55:53 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:53 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e639e97f-0c14-47b9-ad19-973d7f7583e4 tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e" returned: 0 in 0.269s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e639e97f-0c14-47b9-ad19-973d7f7583e4 tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:53 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.info Nov 02 10:55:53 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:54 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e639e97f-0c14-47b9-ad19-973d7f7583e4 tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.info" returned: 0 in 0.259s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:54 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-e639e97f-0c14-47b9-ad19-973d7f7583e4 tempest-VolumesSnapshotListTestJSON-1931421725 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.info is being set with open permissions: ugo+rw Nov 02 10:55:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e639e97f-0c14-47b9-ad19-973d7f7583e4 tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:54 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.info Nov 02 10:55:54 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:54 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e639e97f-0c14-47b9-ad19-973d7f7583e4 tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.info" returned: 0 in 0.254s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e639e97f-0c14-47b9-ad19-973d7f7583e4 tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.241s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e639e97f-0c14-47b9-ad19-973d7f7583e4 tempest-VolumesSnapshotListTestJSON-1931421725 None] Create snapshot completed successfully Nov 02 10:55:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e75a69aa-e2d8-4dcc-ae3d-04063596d956 tempest-VolumesSnapshotListTestJSON-1931421725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e75a69aa-e2d8-4dcc-ae3d-04063596d956 tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-e75a69aa-e2d8-4dcc-ae3d-04063596d956 tempest-VolumesSnapshotListTestJSON-1931421725 None] Creating offline snapshot dac2e517-6774-41b6-be07-2e0541c8a094 of volume bc749d7f-19bc-46cb-8b84-4aeb398a1674 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:55:55 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf63a511-923e-4292-8922-0cf3a5a80108]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e75a69aa-e2d8-4dcc-ae3d-04063596d956 tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:55 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e Nov 02 10:55:55 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:56 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e75a69aa-e2d8-4dcc-ae3d-04063596d956 tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e" returned: 0 in 0.484s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-e75a69aa-e2d8-4dcc-ae3d-04063596d956 tempest-VolumesSnapshotListTestJSON-1931421725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:55:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e75a69aa-e2d8-4dcc-ae3d-04063596d956 tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:56 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 1G Nov 02 10:55:56 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:56 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e75a69aa-e2d8-4dcc-ae3d-04063596d956 tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 1G" returned: 0 in 0.485s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e75a69aa-e2d8-4dcc-ae3d-04063596d956 tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:56 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 Nov 02 10:55:56 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:56 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e75a69aa-e2d8-4dcc-ae3d-04063596d956 tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094" returned: 0 in 0.353s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:56 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-e75a69aa-e2d8-4dcc-ae3d-04063596d956 tempest-VolumesSnapshotListTestJSON-1931421725 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 is being set with open permissions: ugo+rw Nov 02 10:55:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e75a69aa-e2d8-4dcc-ae3d-04063596d956 tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:56 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 Nov 02 10:55:56 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:57 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e75a69aa-e2d8-4dcc-ae3d-04063596d956 tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094" returned: 0 in 0.261s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e75a69aa-e2d8-4dcc-ae3d-04063596d956 tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.717s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e75a69aa-e2d8-4dcc-ae3d-04063596d956 tempest-VolumesSnapshotListTestJSON-1931421725 None] Create snapshot completed successfully Nov 02 10:55:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-18ad56d2-ac86-4891-b83a-44b405ecf0df tempest-VolumesSnapshotListTestJSON-1931421725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-18ad56d2-ac86-4891-b83a-44b405ecf0df tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-18ad56d2-ac86-4891-b83a-44b405ecf0df tempest-VolumesSnapshotListTestJSON-1931421725 None] Creating offline snapshot 08e48120-cd4b-40ae-8d09-09a120cf460d of volume bc749d7f-19bc-46cb-8b84-4aeb398a1674 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:55:57 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f39964-7899-4d69-ab20-88734b8a5e82]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-18ad56d2-ac86-4891-b83a-44b405ecf0df tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:58 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 Nov 02 10:55:58 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:58 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-18ad56d2-ac86-4891-b83a-44b405ecf0df tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094" returned: 0 in 0.396s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-18ad56d2-ac86-4891-b83a-44b405ecf0df tempest-VolumesSnapshotListTestJSON-1931421725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:55:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-18ad56d2-ac86-4891-b83a-44b405ecf0df tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.08e48120-cd4b-40ae-8d09-09a120cf460d 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:58 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.08e48120-cd4b-40ae-8d09-09a120cf460d 1G Nov 02 10:55:58 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:58 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-18ad56d2-ac86-4891-b83a-44b405ecf0df tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.08e48120-cd4b-40ae-8d09-09a120cf460d 1G" returned: 0 in 0.459s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-18ad56d2-ac86-4891-b83a-44b405ecf0df tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.08e48120-cd4b-40ae-8d09-09a120cf460d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:58 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.08e48120-cd4b-40ae-8d09-09a120cf460d Nov 02 10:55:58 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:59 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-18ad56d2-ac86-4891-b83a-44b405ecf0df tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.08e48120-cd4b-40ae-8d09-09a120cf460d" returned: 0 in 0.280s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:59 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-18ad56d2-ac86-4891-b83a-44b405ecf0df tempest-VolumesSnapshotListTestJSON-1931421725 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.08e48120-cd4b-40ae-8d09-09a120cf460d is being set with open permissions: ugo+rw Nov 02 10:55:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-18ad56d2-ac86-4891-b83a-44b405ecf0df tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.08e48120-cd4b-40ae-8d09-09a120cf460d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:59 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.08e48120-cd4b-40ae-8d09-09a120cf460d Nov 02 10:55:59 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:59 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-18ad56d2-ac86-4891-b83a-44b405ecf0df tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.08e48120-cd4b-40ae-8d09-09a120cf460d" returned: 0 in 0.236s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-18ad56d2-ac86-4891-b83a-44b405ecf0df tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.488s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:59 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-18ad56d2-ac86-4891-b83a-44b405ecf0df tempest-VolumesSnapshotListTestJSON-1931421725 None] Create snapshot completed successfully Nov 02 10:56:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] Acquiring lock "cinder-08e48120-cd4b-40ae-8d09-09a120cf460d-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-08e48120-cd4b-40ae-8d09-09a120cf460d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] Acquiring lock "cinder-quobyte-bc749d7f-19bc-46cb-8b84-4aeb398a1674" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-quobyte-bc749d7f-19bc-46cb-8b84-4aeb398a1674" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] Acquiring lock "cinder-quobyte-08e48120-cd4b-40ae-8d09-09a120cf460d" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-quobyte-08e48120-cd4b-40ae-8d09-09a120cf460d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] Deleting offline snapshot 08e48120-cd4b-40ae-8d09-09a120cf460d of volume bc749d7f-19bc-46cb-8b84-4aeb398a1674 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:56:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] snapshot_file for this snap is: volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.08e48120-cd4b-40ae-8d09-09a120cf460d {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:56:00 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94a32e5-9497-4a82-b8ca-2aba6fe15a76]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.08e48120-cd4b-40ae-8d09-09a120cf460d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:01 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.08e48120-cd4b-40ae-8d09-09a120cf460d Nov 02 10:56:01 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:01 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.08e48120-cd4b-40ae-8d09-09a120cf460d" returned: 0 in 0.344s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:01 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb2dbff-1aa9-42c7-ae77-42796c3fafff]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:01 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 Nov 02 10:56:01 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:01 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094" returned: 0 in 0.342s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.08e48120-cd4b-40ae-8d09-09a120cf460d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:01 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.08e48120-cd4b-40ae-8d09-09a120cf460d Nov 02 10:56:01 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:02 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.08e48120-cd4b-40ae-8d09-09a120cf460d" returned: 0 in 0.408s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.08e48120-cd4b-40ae-8d09-09a120cf460d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:02 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.08e48120-cd4b-40ae-8d09-09a120cf460d Nov 02 10:56:02 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:02 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.08e48120-cd4b-40ae-8d09-09a120cf460d" returned: 0 in 0.238s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-quobyte-08e48120-cd4b-40ae-8d09-09a120cf460d" released by "_delete_snapshot" :: held 1.438s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-quobyte-bc749d7f-19bc-46cb-8b84-4aeb398a1674" released by "delete_snapshot" :: held 1.460s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:02 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] Created reservations ['3f21421b-0e73-4e6f-931f-8b401006f8f6', 'f03566ac-3a06-461f-b90b-203830d7e1a0', '2c54ddae-84ce-4b6d-995e-7d450850e965', '8739f1b8-8e64-416c-8bd4-5f85c9ffe374'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:02 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] Delete snapshot completed successfully. Nov 02 10:56:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-73c5435b-7581-4007-80e1-ece97ca633ce tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-08e48120-cd4b-40ae-8d09-09a120cf460d-delete_snapshot" released by "delete_snapshot" :: held 1.611s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] Acquiring lock "cinder-dac2e517-6774-41b6-be07-2e0541c8a094-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-dac2e517-6774-41b6-be07-2e0541c8a094-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] Acquiring lock "cinder-quobyte-bc749d7f-19bc-46cb-8b84-4aeb398a1674" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-quobyte-bc749d7f-19bc-46cb-8b84-4aeb398a1674" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] Acquiring lock "cinder-quobyte-dac2e517-6774-41b6-be07-2e0541c8a094" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-quobyte-dac2e517-6774-41b6-be07-2e0541c8a094" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] Deleting offline snapshot dac2e517-6774-41b6-be07-2e0541c8a094 of volume bc749d7f-19bc-46cb-8b84-4aeb398a1674 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:56:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] snapshot_file for this snap is: volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:56:03 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8256d53a-7f00-4031-9c99-73ffb5c56519]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:03 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 Nov 02 10:56:03 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:03 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094" returned: 0 in 0.340s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:03 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e209f7-73cf-472b-8c62-e41fa7bb7b39]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:03 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e Nov 02 10:56:03 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:03 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e" returned: 0 in 0.353s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:03 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 Nov 02 10:56:03 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:04 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094" returned: 0 in 0.377s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:04 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094 Nov 02 10:56:04 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:04 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.dac2e517-6774-41b6-be07-2e0541c8a094" returned: 0 in 0.231s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-quobyte-dac2e517-6774-41b6-be07-2e0541c8a094" released by "_delete_snapshot" :: held 1.417s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-quobyte-bc749d7f-19bc-46cb-8b84-4aeb398a1674" released by "delete_snapshot" :: held 1.442s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:04 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] Created reservations ['5056562b-37de-4047-bfa4-a3e012569b5f', 'f276fa6e-647b-4b1a-8b74-38f023c19d55', '8c98077e-8d8e-48e7-80ff-f628b08ce3aa', 'd8d36e1d-8ef7-4142-93af-9d4f76f272ab'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:04 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] Delete snapshot completed successfully. Nov 02 10:56:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-265d26fa-44cd-4a63-95a0-5f8d35859697 tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-dac2e517-6774-41b6-be07-2e0541c8a094-delete_snapshot" released by "delete_snapshot" :: held 1.572s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] Acquiring lock "cinder-af0627b5-b2a1-42a4-992a-9173dd288d4e-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-af0627b5-b2a1-42a4-992a-9173dd288d4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] Acquiring lock "cinder-quobyte-bc749d7f-19bc-46cb-8b84-4aeb398a1674" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-quobyte-bc749d7f-19bc-46cb-8b84-4aeb398a1674" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] Acquiring lock "cinder-quobyte-af0627b5-b2a1-42a4-992a-9173dd288d4e" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-quobyte-af0627b5-b2a1-42a4-992a-9173dd288d4e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] Deleting offline snapshot af0627b5-b2a1-42a4-992a-9173dd288d4e of volume bc749d7f-19bc-46cb-8b84-4aeb398a1674 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:56:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] snapshot_file for this snap is: volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:56:05 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87e8c9e-b1b4-438e-bd2c-dc1b1d758827]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:05 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e Nov 02 10:56:05 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:05 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e" returned: 0 in 0.343s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:05 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e759c2-e620-4097-b64f-3a827d00de6b]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:05 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674 Nov 02 10:56:05 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:05 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674" returned: 0 in 0.344s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:05 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e Nov 02 10:56:05 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:06 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e" returned: 0 in 0.316s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:06 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e Nov 02 10:56:06 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:06 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674.af0627b5-b2a1-42a4-992a-9173dd288d4e" returned: 0 in 0.240s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-quobyte-af0627b5-b2a1-42a4-992a-9173dd288d4e" released by "_delete_snapshot" :: held 1.346s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-quobyte-bc749d7f-19bc-46cb-8b84-4aeb398a1674" released by "delete_snapshot" :: held 1.365s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:06 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] Created reservations ['39ff367f-2bd4-4c96-9077-15a746d3bb21', '4e3903d3-4cfc-43a6-932e-b7c724311839', '72d44603-13e6-4c45-9849-71f089fd0950', '8f77e33c-5e0c-4c7a-a5f9-470dac597faa'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:06 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] Delete snapshot completed successfully. Nov 02 10:56:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c2800f3-cdd0-42a4-8fda-6be0dde6b4cf tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-af0627b5-b2a1-42a4-992a-9173dd288d4e-delete_snapshot" released by "delete_snapshot" :: held 1.486s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1d518cba-e037-413d-990f-ba5a577f127d tempest-VolumesSnapshotListTestJSON-1931421725 None] Acquiring lock "cinder-bc749d7f-19bc-46cb-8b84-4aeb398a1674-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1d518cba-e037-413d-990f-ba5a577f127d tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-bc749d7f-19bc-46cb-8b84-4aeb398a1674-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1d518cba-e037-413d-990f-ba5a577f127d tempest-VolumesSnapshotListTestJSON-1931421725 None] Acquiring lock "cinder-quobyte-bc749d7f-19bc-46cb-8b84-4aeb398a1674" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1d518cba-e037-413d-990f-ba5a577f127d tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-quobyte-bc749d7f-19bc-46cb-8b84-4aeb398a1674" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:07 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc10c5f4-22fd-430d-9a52-bcd9b8237d9b]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d518cba-e037-413d-990f-ba5a577f127d tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:07 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674 Nov 02 10:56:07 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:07 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d518cba-e037-413d-990f-ba5a577f127d tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674" returned: 0 in 0.369s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d518cba-e037-413d-990f-ba5a577f127d tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:07 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674 Nov 02 10:56:07 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:08 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d518cba-e037-413d-990f-ba5a577f127d tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-bc749d7f-19bc-46cb-8b84-4aeb398a1674" returned: 0 in 0.239s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1d518cba-e037-413d-990f-ba5a577f127d tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-quobyte-bc749d7f-19bc-46cb-8b84-4aeb398a1674" released by "delete_volume" :: held 0.686s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:08 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-1d518cba-e037-413d-990f-ba5a577f127d tempest-VolumesSnapshotListTestJSON-1931421725 None] Created reservations ['0e2270cb-10c0-4108-8574-abf0a473da4c', 'aa8da479-cb68-4e14-953a-ae2acf0f6ece', '5b7c1b5c-fd7f-41c4-8659-c3af20ca0e5d', '4f0a5e83-7e57-48c0-a359-67ece42e3d1e'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d518cba-e037-413d-990f-ba5a577f127d tempest-VolumesSnapshotListTestJSON-1931421725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d518cba-e037-413d-990f-ba5a577f127d tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1d518cba-e037-413d-990f-ba5a577f127d tempest-VolumesSnapshotListTestJSON-1931421725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1d518cba-e037-413d-990f-ba5a577f127d tempest-VolumesSnapshotListTestJSON-1931421725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d518cba-e037-413d-990f-ba5a577f127d tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d518cba-e037-413d-990f-ba5a577f127d tempest-VolumesSnapshotListTestJSON-1931421725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:08 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:56:08 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:08 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d518cba-e037-413d-990f-ba5a577f127d tempest-VolumesSnapshotListTestJSON-1931421725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.236s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:08 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-1d518cba-e037-413d-990f-ba5a577f127d tempest-VolumesSnapshotListTestJSON-1931421725 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:08 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1d518cba-e037-413d-990f-ba5a577f127d tempest-VolumesSnapshotListTestJSON-1931421725 None] Deleted volume successfully. Nov 02 10:56:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1d518cba-e037-413d-990f-ba5a577f127d tempest-VolumesSnapshotListTestJSON-1931421725 None] Lock "cinder-bc749d7f-19bc-46cb-8b84-4aeb398a1674-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-65f3e528-af9d-4d98-9df7-80c5c60d1833 req-d6b6bacd-90ca-49c9-913c-5d12402b5cae tempest-TestStampPattern-597707380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-65f3e528-af9d-4d98-9df7-80c5c60d1833 req-d6b6bacd-90ca-49c9-913c-5d12402b5cae tempest-TestStampPattern-597707380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-65f3e528-af9d-4d98-9df7-80c5c60d1833 req-d6b6bacd-90ca-49c9-913c-5d12402b5cae tempest-TestStampPattern-597707380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-65f3e528-af9d-4d98-9df7-80c5c60d1833 req-d6b6bacd-90ca-49c9-913c-5d12402b5cae tempest-TestStampPattern-597707380 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-aff332aa-719f-446c-9e11-cf81cbe7594b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b2a8b2e-2804-4a94-9378-155cd6019505', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:56:09 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-65f3e528-af9d-4d98-9df7-80c5c60d1833 req-d6b6bacd-90ca-49c9-913c-5d12402b5cae tempest-TestStampPattern-597707380 None] attachment_update completed successfully. Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Flow 'volume_create_manager' (804fda5e-a4e6-4e77-b98e-87365b3418d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6203008-f1a5-40ed-8d28-2f48b63b7b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6203008-f1a5-40ed-8d28-2f48b63b7b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2000400616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b7e177-1d0b-41bb-9f32-93b0748e1374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78d98db8e6d48fca7a9ba85a8120de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:12Z,use_quota=True,user_id='2060e17a85464e39a1f939d53a7488b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed53523-788d-4393-a30b-42824dff5bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed53523-788d-4393-a30b-42824dff5bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf103a71-5c3f-4475-aa8f-e26a4ce3f8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf103a71-5c3f-4475-aa8f-e26a4ce3f8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8b7e177-1d0b-41bb-9f32-93b0748e1374', 'volume_name': 'volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374', 'volume_size': 2}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a7c629-cef5-4834-8a60-1fad37bd72e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a7c629-cef5-4834-8a60-1fad37bd72e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (751f1ee9-e3bc-4a2f-85fb-23c8159fbc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:12 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Volume c8b7e177-1d0b-41bb-9f32-93b0748e1374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374', 'volume_size': 2} Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2000400616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b7e177-1d0b-41bb-9f32-93b0748e1374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78d98db8e6d48fca7a9ba85a8120de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:12Z,use_quota=True,user_id='2060e17a85464e39a1f939d53a7488b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Creating volume c8b7e177-1d0b-41bb-9f32-93b0748e1374 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:56:12 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:56:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374 2147483648 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:12 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374 2147483648 Nov 02 10:56:12 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:13 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374 2147483648" returned: 0 in 0.493s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:13 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374 Nov 02 10:56:13 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:13 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374" returned: 0 in 0.242s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:56:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (751f1ee9-e3bc-4a2f-85fb-23c8159fbc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374', 'volume_size': 2}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28dcf53f-f735-4de5-b432-f4f4103784fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:13 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Volume volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374 (c8b7e177-1d0b-41bb-9f32-93b0748e1374): created successfully Nov 02 10:56:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28dcf53f-f735-4de5-b432-f4f4103784fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Flow 'volume_create_manager' (804fda5e-a4e6-4e77-b98e-87365b3418d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:13 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c0af3888-14d1-4175-8fe8-e8b276642d4a tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Created volume successfully. Nov 02 10:56:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f07b39d-55e4-48e0-a03e-9c299d61c693 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f07b39d-55e4-48e0-a03e-9c299d61c693 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1f07b39d-55e4-48e0-a03e-9c299d61c693 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Creating offline snapshot 60585753-be24-4d1a-a78c-0227a19be0c0 of volume c8b7e177-1d0b-41bb-9f32-93b0748e1374 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:56:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[548d862f-b88e-427f-9f2c-a3586413e56f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f07b39d-55e4-48e0-a03e-9c299d61c693 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:14 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374 Nov 02 10:56:14 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:15 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-f9c747e9-3ade-46b0-87b5-fc741b0948c3 req-2ea3b913-554c-49d7-ac44-f1f9f157034a tempest-TestStampPattern-597707380 None] Terminate volume connection completed successfully. Nov 02 10:56:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-f9c747e9-3ade-46b0-87b5-fc741b0948c3 req-2ea3b913-554c-49d7-ac44-f1f9f157034a tempest-TestStampPattern-597707380 None] Deleting attachment 1b2a8b2e-2804-4a94-9378-155cd6019505. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:56:15 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f07b39d-55e4-48e0-a03e-9c299d61c693 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374" returned: 0 in 0.400s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f07b39d-55e4-48e0-a03e-9c299d61c693 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.60585753-be24-4d1a-a78c-0227a19be0c0 2G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:15 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.60585753-be24-4d1a-a78c-0227a19be0c0 2G Nov 02 10:56:15 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:15 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f07b39d-55e4-48e0-a03e-9c299d61c693 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.60585753-be24-4d1a-a78c-0227a19be0c0 2G" returned: 0 in 0.418s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f07b39d-55e4-48e0-a03e-9c299d61c693 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.60585753-be24-4d1a-a78c-0227a19be0c0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:15 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.60585753-be24-4d1a-a78c-0227a19be0c0 Nov 02 10:56:15 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:15 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f07b39d-55e4-48e0-a03e-9c299d61c693 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.60585753-be24-4d1a-a78c-0227a19be0c0" returned: 0 in 0.307s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:15 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-1f07b39d-55e4-48e0-a03e-9c299d61c693 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.60585753-be24-4d1a-a78c-0227a19be0c0 is being set with open permissions: ugo+rw Nov 02 10:56:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f07b39d-55e4-48e0-a03e-9c299d61c693 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.60585753-be24-4d1a-a78c-0227a19be0c0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:15 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.60585753-be24-4d1a-a78c-0227a19be0c0 Nov 02 10:56:15 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3c6965a7-017d-4c17-bb3b-d40b12c09ffa tempest-TestStampPattern-597707380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:16 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f07b39d-55e4-48e0-a03e-9c299d61c693 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.60585753-be24-4d1a-a78c-0227a19be0c0" returned: 0 in 0.272s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f07b39d-55e4-48e0-a03e-9c299d61c693 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:16 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.info Nov 02 10:56:16 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:16 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f07b39d-55e4-48e0-a03e-9c299d61c693 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.info" returned: 0 in 0.240s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:16 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-1f07b39d-55e4-48e0-a03e-9c299d61c693 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.info is being set with open permissions: ugo+rw Nov 02 10:56:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f07b39d-55e4-48e0-a03e-9c299d61c693 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:16 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.info Nov 02 10:56:16 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:16 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f07b39d-55e4-48e0-a03e-9c299d61c693 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.info" returned: 0 in 0.233s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f07b39d-55e4-48e0-a03e-9c299d61c693 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.967s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3c6965a7-017d-4c17-bb3b-d40b12c09ffa tempest-TestStampPattern-597707380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.760s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-3c6965a7-017d-4c17-bb3b-d40b12c09ffa tempest-TestStampPattern-597707380 None] Creating offline snapshot 68af72e4-1193-470b-9a8f-fa21d22b005b of volume aff332aa-719f-446c-9e11-cf81cbe7594b {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:56:16 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1f07b39d-55e4-48e0-a03e-9c299d61c693 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Create snapshot completed successfully Nov 02 10:56:16 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6c608e-cb11-44b7-b059-e10db57d080c]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c6965a7-017d-4c17-bb3b-d40b12c09ffa tempest-TestStampPattern-597707380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:16 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b Nov 02 10:56:16 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:17 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c6965a7-017d-4c17-bb3b-d40b12c09ffa tempest-TestStampPattern-597707380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b" returned: 0 in 0.417s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c6965a7-017d-4c17-bb3b-d40b12c09ffa tempest-TestStampPattern-597707380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:17 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b 1G Nov 02 10:56:17 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:17 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c6965a7-017d-4c17-bb3b-d40b12c09ffa tempest-TestStampPattern-597707380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b 1G" returned: 0 in 0.407s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c6965a7-017d-4c17-bb3b-d40b12c09ffa tempest-TestStampPattern-597707380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aff332aa-719f-446c-9e11-cf81cbe7594b -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:17 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aff332aa-719f-446c-9e11-cf81cbe7594b -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b Nov 02 10:56:17 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:17 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c6965a7-017d-4c17-bb3b-d40b12c09ffa tempest-TestStampPattern-597707380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aff332aa-719f-446c-9e11-cf81cbe7594b -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b" returned: 0 in 0.322s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:17 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-3c6965a7-017d-4c17-bb3b-d40b12c09ffa tempest-TestStampPattern-597707380 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b is being set with open permissions: ugo+rw Nov 02 10:56:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c6965a7-017d-4c17-bb3b-d40b12c09ffa tempest-TestStampPattern-597707380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:17 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b Nov 02 10:56:17 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Acquiring lock "cinder-60585753-be24-4d1a-a78c-0227a19be0c0-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Lock "cinder-60585753-be24-4d1a-a78c-0227a19be0c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Acquiring lock "cinder-quobyte-c8b7e177-1d0b-41bb-9f32-93b0748e1374" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Lock "cinder-quobyte-c8b7e177-1d0b-41bb-9f32-93b0748e1374" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Acquiring lock "cinder-quobyte-60585753-be24-4d1a-a78c-0227a19be0c0" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Lock "cinder-quobyte-60585753-be24-4d1a-a78c-0227a19be0c0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Deleting offline snapshot 60585753-be24-4d1a-a78c-0227a19be0c0 of volume c8b7e177-1d0b-41bb-9f32-93b0748e1374 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] snapshot_file for this snap is: volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.60585753-be24-4d1a-a78c-0227a19be0c0 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2165282a-2dea-484f-8261-7d2ca6a81236]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.60585753-be24-4d1a-a78c-0227a19be0c0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:18 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.60585753-be24-4d1a-a78c-0227a19be0c0 Nov 02 10:56:18 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:18 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c6965a7-017d-4c17-bb3b-d40b12c09ffa tempest-TestStampPattern-597707380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b" returned: 0 in 0.294s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c6965a7-017d-4c17-bb3b-d40b12c09ffa tempest-TestStampPattern-597707380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:18 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.info Nov 02 10:56:18 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:18 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.60585753-be24-4d1a-a78c-0227a19be0c0" returned: 0 in 0.371s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2f3135-b66e-49a0-a713-955fc9ba16ab]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:18 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c6965a7-017d-4c17-bb3b-d40b12c09ffa tempest-TestStampPattern-597707380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.info" returned: 0 in 0.263s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:18 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-3c6965a7-017d-4c17-bb3b-d40b12c09ffa tempest-TestStampPattern-597707380 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.info is being set with open permissions: ugo+rw Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c6965a7-017d-4c17-bb3b-d40b12c09ffa tempest-TestStampPattern-597707380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:18 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.info Nov 02 10:56:18 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:18 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374 Nov 02 10:56:18 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:18 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c6965a7-017d-4c17-bb3b-d40b12c09ffa tempest-TestStampPattern-597707380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.info" returned: 0 in 0.242s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3c6965a7-017d-4c17-bb3b-d40b12c09ffa tempest-TestStampPattern-597707380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.052s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:18 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3c6965a7-017d-4c17-bb3b-d40b12c09ffa tempest-TestStampPattern-597707380 None] Create snapshot completed successfully Nov 02 10:56:18 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374" returned: 0 in 0.417s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.60585753-be24-4d1a-a78c-0227a19be0c0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:18 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.60585753-be24-4d1a-a78c-0227a19be0c0 Nov 02 10:56:18 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:19 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.60585753-be24-4d1a-a78c-0227a19be0c0" returned: 0 in 0.383s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.60585753-be24-4d1a-a78c-0227a19be0c0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:19 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.60585753-be24-4d1a-a78c-0227a19be0c0 Nov 02 10:56:19 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:19 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374.60585753-be24-4d1a-a78c-0227a19be0c0" returned: 0 in 0.279s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Lock "cinder-quobyte-60585753-be24-4d1a-a78c-0227a19be0c0" released by "_delete_snapshot" :: held 1.574s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Lock "cinder-quobyte-c8b7e177-1d0b-41bb-9f32-93b0748e1374" released by "delete_snapshot" :: held 1.599s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:19 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Created reservations ['cc672df1-1bda-41ce-859f-9b35276c11b9', 'de8c262e-a282-4653-aef5-fb22e9adeb4a', 'cf8f3316-3a40-441c-aaef-8a3135bab77f', 'a960a5a6-e588-455b-9f88-c352b7944acd'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:19 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Delete snapshot completed successfully. Nov 02 10:56:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-16576505-a188-4b9b-9541-5eb101393376 tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Lock "cinder-60585753-be24-4d1a-a78c-0227a19be0c0-delete_snapshot" released by "delete_snapshot" :: held 1.736s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b8d85d76-b163-49ef-87f6-4d50851667ec tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Acquiring lock "cinder-c8b7e177-1d0b-41bb-9f32-93b0748e1374-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b8d85d76-b163-49ef-87f6-4d50851667ec tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Lock "cinder-c8b7e177-1d0b-41bb-9f32-93b0748e1374-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b8d85d76-b163-49ef-87f6-4d50851667ec tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Acquiring lock "cinder-quobyte-c8b7e177-1d0b-41bb-9f32-93b0748e1374" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b8d85d76-b163-49ef-87f6-4d50851667ec tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Lock "cinder-quobyte-c8b7e177-1d0b-41bb-9f32-93b0748e1374" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:20 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8545ce30-88ae-4695-a1c0-39886def61a0]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b8d85d76-b163-49ef-87f6-4d50851667ec tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:20 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374 Nov 02 10:56:20 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:20 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b8d85d76-b163-49ef-87f6-4d50851667ec tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374" returned: 0 in 0.387s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b8d85d76-b163-49ef-87f6-4d50851667ec tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:20 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374 Nov 02 10:56:20 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:21 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b8d85d76-b163-49ef-87f6-4d50851667ec tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c8b7e177-1d0b-41bb-9f32-93b0748e1374" returned: 0 in 0.258s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b8d85d76-b163-49ef-87f6-4d50851667ec tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Lock "cinder-quobyte-c8b7e177-1d0b-41bb-9f32-93b0748e1374" released by "delete_volume" :: held 0.721s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:21 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-b8d85d76-b163-49ef-87f6-4d50851667ec tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Created reservations ['9cd2964d-0bf3-47ce-9884-0e1fc13687d4', 'ee1ee4f9-220c-4bc2-b98c-2639150312e7', '42bbf9a4-6140-4bc4-9727-e0b9ae786a98', 'cfa77169-0aeb-4c5f-918e-1e92e66704c2'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b8d85d76-b163-49ef-87f6-4d50851667ec tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b8d85d76-b163-49ef-87f6-4d50851667ec tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b8d85d76-b163-49ef-87f6-4d50851667ec tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b8d85d76-b163-49ef-87f6-4d50851667ec tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b8d85d76-b163-49ef-87f6-4d50851667ec tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b8d85d76-b163-49ef-87f6-4d50851667ec tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:21 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:56:21 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:21 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b8d85d76-b163-49ef-87f6-4d50851667ec tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.249s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:21 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b8d85d76-b163-49ef-87f6-4d50851667ec tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:21 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b8d85d76-b163-49ef-87f6-4d50851667ec tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Deleted volume successfully. Nov 02 10:56:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b8d85d76-b163-49ef-87f6-4d50851667ec tempest-VolumesSnapshotNegativeTestJSON-1927389383 None] Lock "cinder-c8b7e177-1d0b-41bb-9f32-93b0748e1374-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:25 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:56:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Flow 'volume_create_manager' (93d62d4d-1a1f-4671-930e-0f8115b205d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1131f79-f5c4-4ac1-b70d-f4ec7f7fe1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1131f79-f5c4-4ac1-b70d-f4ec7f7fe1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1666911170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a2cd7e-418f-42ea-a916-86e73dc61986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7818603146b74e898007fcfe2e4f0b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=68af72e4-1193-470b-9a8f-fa21d22b005b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:26Z,use_quota=True,user_id='6c3689cdfd4c4b34a5ff63e25a98e984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a081e35b-e273-4c98-be74-29cf53dd208d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a081e35b-e273-4c98-be74-29cf53dd208d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b608bf-f94d-43b3-b682-278f74968a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b608bf-f94d-43b3-b682-278f74968a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b9a2cd7e-418f-42ea-a916-86e73dc61986', 'volume_name': 'volume-b9a2cd7e-418f-42ea-a916-86e73dc61986', 'volume_size': 1, 'snapshot_id': '68af72e4-1193-470b-9a8f-fa21d22b005b'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b64ca2-34c5-4553-a31f-e76cf1890396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b64ca2-34c5-4553-a31f-e76cf1890396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d891cf4d-43ec-41d2-b833-02689421d3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:26 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Volume b9a2cd7e-418f-42ea-a916-86e73dc61986: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b9a2cd7e-418f-42ea-a916-86e73dc61986', 'volume_size': 1, 'snapshot_id': '68af72e4-1193-470b-9a8f-fa21d22b005b'} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Acquiring lock "cinder-quobyte-68af72e4-1193-470b-9a8f-fa21d22b005b-b9a2cd7e-418f-42ea-a916-86e73dc61986" by "_create_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Lock "cinder-quobyte-68af72e4-1193-470b-9a8f-fa21d22b005b-b9a2cd7e-418f-42ea-a916-86e73dc61986" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Creating volume b9a2cd7e-418f-42ea-a916-86e73dc61986 from snapshot 68af72e4-1193-470b-9a8f-fa21d22b005b {{(pid=87084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Acquiring lock "cinder-quobyte-b9a2cd7e-418f-42ea-a916-86e73dc61986" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Lock "cinder-quobyte-b9a2cd7e-418f-42ea-a916-86e73dc61986" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] snapshot: 68af72e4-1193-470b-9a8f-fa21d22b005b, volume: b9a2cd7e-418f-42ea-a916-86e73dc61986, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9533b74-bab5-4a47-8bf7-afe2f0990daf]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:26 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b Nov 02 10:56:26 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:26 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b" returned: 0 in 0.411s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aff332aa-719f-446c-9e11-cf81cbe7594b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[64722b41-1db8-46df-b466-9cbdc7cf8b6b]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:26 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b Nov 02 10:56:26 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:27 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b" returned: 0 in 0.451s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:56:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:56:27 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Path /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9a2cd7e-418f-42ea-a916-86e73dc61986 not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:56:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9a2cd7e-418f-42ea-a916-86e73dc61986 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:27 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9a2cd7e-418f-42ea-a916-86e73dc61986 Nov 02 10:56:27 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:35 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=86,cinder:SELECT=76,cinder:INSERT=22,cinder:DELETE=9 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:56:36 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=90,cinder:UPDATE=89,cinder:INSERT=25,cinder:DELETE=5 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:56:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9a2cd7e-418f-42ea-a916-86e73dc61986" returned: 0 in 9.530s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:36 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Image conversion details: src /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b, size 1024.00 MB, duration 9.53 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9a2cd7e-418f-42ea-a916-86e73dc61986 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:56:36 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Converted 1024.00 MB image at 107.43 MB/s Nov 02 10:56:36 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9a2cd7e-418f-42ea-a916-86e73dc61986 is being set with open permissions: ugo+rw Nov 02 10:56:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9a2cd7e-418f-42ea-a916-86e73dc61986 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:36 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9a2cd7e-418f-42ea-a916-86e73dc61986 Nov 02 10:56:36 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:37 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9a2cd7e-418f-42ea-a916-86e73dc61986" returned: 0 in 0.453s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Lock "cinder-quobyte-b9a2cd7e-418f-42ea-a916-86e73dc61986" released by "_copy_volume_from_snapshot" :: held 10.955s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Lock "cinder-quobyte-68af72e4-1193-470b-9a8f-fa21d22b005b-b9a2cd7e-418f-42ea-a916-86e73dc61986" released by "_create_volume_from_snapshot" :: held 11.040s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.067s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d891cf4d-43ec-41d2-b833-02689421d3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a2cd7e-418f-42ea-a916-86e73dc61986', 'volume_size': 1, 'snapshot_id': '68af72e4-1193-470b-9a8f-fa21d22b005b'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ac2da8-aac1-4ef3-b5c8-7a99ee264934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:37 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Volume volume-b9a2cd7e-418f-42ea-a916-86e73dc61986 (b9a2cd7e-418f-42ea-a916-86e73dc61986): created successfully Nov 02 10:56:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ac2da8-aac1-4ef3-b5c8-7a99ee264934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Flow 'volume_create_manager' (93d62d4d-1a1f-4671-930e-0f8115b205d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f79e13c3-977c-437c-8ffa-2a09094abc8a tempest-TestStampPattern-597707380 None] Created volume successfully. Nov 02 10:56:51 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:56:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Flow 'volume_create_manager' (34635f47-a1bf-4977-a7f9-c9a983e2e706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7f8121-5765-415e-90e8-6e610704c00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7f8121-5765-415e-90e8-6e610704c00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-703434280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e6dd9b-3a82-4746-954b-8a60404065a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80b09987dd0452397b85cc1b427fa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:52Z,use_quota=True,user_id='d80ec192113241a6a046cff6b4fe2b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180e4e93-f16c-4b85-b732-152e5913e739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180e4e93-f16c-4b85-b732-152e5913e739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b569fda-799c-4642-be09-d48e50934b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b569fda-799c-4642-be09-d48e50934b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06e6dd9b-3a82-4746-954b-8a60404065a6', 'volume_name': 'volume-06e6dd9b-3a82-4746-954b-8a60404065a6', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afa7353-bee5-49bb-a31c-91f076ba2010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afa7353-bee5-49bb-a31c-91f076ba2010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfcc7846-d20b-4ba7-941c-5c6f49429fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:51 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Volume 06e6dd9b-3a82-4746-954b-8a60404065a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06e6dd9b-3a82-4746-954b-8a60404065a6', 'volume_size': 1} Nov 02 10:56:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-703434280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e6dd9b-3a82-4746-954b-8a60404065a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80b09987dd0452397b85cc1b427fa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:52Z,use_quota=True,user_id='d80ec192113241a6a046cff6b4fe2b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Creating volume 06e6dd9b-3a82-4746-954b-8a60404065a6 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:56:52 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-06e6dd9b-3a82-4746-954b-8a60404065a6 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:52 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-06e6dd9b-3a82-4746-954b-8a60404065a6 1073741824 Nov 02 10:56:52 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Flow 'volume_create_manager' (0c015cac-39d3-4368-acfd-bb05ade4c6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a28061-9714-4bb8-b361-f090d374ac44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a28061-9714-4bb8-b361-f090d374ac44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-377163311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9b9e93-a444-4a94-b7ba-50c240717193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80b09987dd0452397b85cc1b427fa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:52Z,use_quota=True,user_id='d80ec192113241a6a046cff6b4fe2b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8844a247-a4c1-4252-922f-74b585a7c906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8844a247-a4c1-4252-922f-74b585a7c906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5c830a-3885-45da-88cb-abe3d641a4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5c830a-3885-45da-88cb-abe3d641a4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a9b9e93-a444-4a94-b7ba-50c240717193', 'volume_name': 'volume-0a9b9e93-a444-4a94-b7ba-50c240717193', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d3d8b3-fbc7-4fa1-9d4b-1cb3674a38d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d3d8b3-fbc7-4fa1-9d4b-1cb3674a38d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63066cc4-ac3b-406b-aeea-bf0a20919f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:52 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Volume 0a9b9e93-a444-4a94-b7ba-50c240717193: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a9b9e93-a444-4a94-b7ba-50c240717193', 'volume_size': 1} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:52 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-06e6dd9b-3a82-4746-954b-8a60404065a6 1073741824" returned: 0 in 0.528s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-06e6dd9b-3a82-4746-954b-8a60404065a6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:52 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-06e6dd9b-3a82-4746-954b-8a60404065a6 Nov 02 10:56:52 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:52 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-06e6dd9b-3a82-4746-954b-8a60404065a6" returned: 0 in 0.263s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.484s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-377163311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9b9e93-a444-4a94-b7ba-50c240717193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80b09987dd0452397b85cc1b427fa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:52Z,use_quota=True,user_id='d80ec192113241a6a046cff6b4fe2b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Creating volume 0a9b9e93-a444-4a94-b7ba-50c240717193 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:56:52 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0a9b9e93-a444-4a94-b7ba-50c240717193 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfcc7846-d20b-4ba7-941c-5c6f49429fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06e6dd9b-3a82-4746-954b-8a60404065a6', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4e1c80-8809-4b80-9cf3-54db08879f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:52 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0a9b9e93-a444-4a94-b7ba-50c240717193 1073741824 Nov 02 10:56:52 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:52 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Volume volume-06e6dd9b-3a82-4746-954b-8a60404065a6 (06e6dd9b-3a82-4746-954b-8a60404065a6): created successfully Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4e1c80-8809-4b80-9cf3-54db08879f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Flow 'volume_create_manager' (34635f47-a1bf-4977-a7f9-c9a983e2e706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:52 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-fac1d4cf-e215-4bb0-9e31-3e57c6ba5a45 tempest-TestServerVolumeAttachmentScenario-660481739 None] Created volume successfully. Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:53 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:56:53 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:53 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0a9b9e93-a444-4a94-b7ba-50c240717193 1073741824" returned: 0 in 0.497s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:53 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.285s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0a9b9e93-a444-4a94-b7ba-50c240717193 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:53 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0a9b9e93-a444-4a94-b7ba-50c240717193 Nov 02 10:56:53 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:53 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0a9b9e93-a444-4a94-b7ba-50c240717193" returned: 0 in 0.271s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63066cc4-ac3b-406b-aeea-bf0a20919f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a9b9e93-a444-4a94-b7ba-50c240717193', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc69b8e-cb7f-4e5d-9fdf-2d2ba1626771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:53 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Volume volume-0a9b9e93-a444-4a94-b7ba-50c240717193 (0a9b9e93-a444-4a94-b7ba-50c240717193): created successfully Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc69b8e-cb7f-4e5d-9fdf-2d2ba1626771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Flow 'volume_create_manager' (0c015cac-39d3-4368-acfd-bb05ade4c6c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:53 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e91b1294-5447-4bda-a45b-48a1c069e4a6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Created volume successfully. Nov 02 10:57:03 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:57:03 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:57:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-4cd12905-d9d3-4eea-8ffc-e42171a29b86 req-996f41c2-b7d6-448b-9e75-369df0b44f14 tempest-TestStampPattern-597707380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-4cd12905-d9d3-4eea-8ffc-e42171a29b86 req-996f41c2-b7d6-448b-9e75-369df0b44f14 tempest-TestStampPattern-597707380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-4cd12905-d9d3-4eea-8ffc-e42171a29b86 req-996f41c2-b7d6-448b-9e75-369df0b44f14 tempest-TestStampPattern-597707380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-4cd12905-d9d3-4eea-8ffc-e42171a29b86 req-996f41c2-b7d6-448b-9e75-369df0b44f14 tempest-TestStampPattern-597707380 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-b9a2cd7e-418f-42ea-a916-86e73dc61986', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9677140f-a087-42f9-9b36-8c62adefe545', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:57:19 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-4cd12905-d9d3-4eea-8ffc-e42171a29b86 req-996f41c2-b7d6-448b-9e75-369df0b44f14 tempest-TestStampPattern-597707380 None] attachment_update completed successfully. Nov 02 10:57:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-f86bb297-4fe0-4fa5-8c99-37e0861d931a req-a9c4e39d-60ea-4de7-b87a-153eaf84a17c tempest-TestStampPattern-597707380 None] Terminate volume connection completed successfully. Nov 02 10:57:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-f86bb297-4fe0-4fa5-8c99-37e0861d931a req-a9c4e39d-60ea-4de7-b87a-153eaf84a17c tempest-TestStampPattern-597707380 None] Deleting attachment 9677140f-a087-42f9-9b36-8c62adefe545. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:57:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-f7df5552-d5b9-4b0a-b368-45e1293e5edb req-99b4204b-06b8-4daf-9ee2-aedf066330b9 tempest-TestServerVolumeAttachmentScenario-660481739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-f7df5552-d5b9-4b0a-b368-45e1293e5edb req-99b4204b-06b8-4daf-9ee2-aedf066330b9 tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-f7df5552-d5b9-4b0a-b368-45e1293e5edb req-99b4204b-06b8-4daf-9ee2-aedf066330b9 tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-f7df5552-d5b9-4b0a-b368-45e1293e5edb req-99b4204b-06b8-4daf-9ee2-aedf066330b9 tempest-TestServerVolumeAttachmentScenario-660481739 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-06e6dd9b-3a82-4746-954b-8a60404065a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38fce3fa-9d6f-4284-8866-af9961aa6bae', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:57:24 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-f7df5552-d5b9-4b0a-b368-45e1293e5edb req-99b4204b-06b8-4daf-9ee2-aedf066330b9 tempest-TestServerVolumeAttachmentScenario-660481739 None] attachment_update completed successfully. Nov 02 10:57:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-32a57ba0-97a4-4567-9695-70d48076607a tempest-TestStampPattern-597707380 None] Acquiring lock "cinder-b9a2cd7e-418f-42ea-a916-86e73dc61986-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-32a57ba0-97a4-4567-9695-70d48076607a tempest-TestStampPattern-597707380 None] Lock "cinder-b9a2cd7e-418f-42ea-a916-86e73dc61986-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-32a57ba0-97a4-4567-9695-70d48076607a tempest-TestStampPattern-597707380 None] Acquiring lock "cinder-quobyte-b9a2cd7e-418f-42ea-a916-86e73dc61986" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-32a57ba0-97a4-4567-9695-70d48076607a tempest-TestStampPattern-597707380 None] Lock "cinder-quobyte-b9a2cd7e-418f-42ea-a916-86e73dc61986" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:27 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7006935-d716-4a1d-a4c1-aebdba8cd778]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-32a57ba0-97a4-4567-9695-70d48076607a tempest-TestStampPattern-597707380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9a2cd7e-418f-42ea-a916-86e73dc61986 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:27 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9a2cd7e-418f-42ea-a916-86e73dc61986 Nov 02 10:57:27 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:28 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-32a57ba0-97a4-4567-9695-70d48076607a tempest-TestStampPattern-597707380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9a2cd7e-418f-42ea-a916-86e73dc61986" returned: 0 in 0.397s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-32a57ba0-97a4-4567-9695-70d48076607a tempest-TestStampPattern-597707380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9a2cd7e-418f-42ea-a916-86e73dc61986 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:28 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9a2cd7e-418f-42ea-a916-86e73dc61986 Nov 02 10:57:28 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:28 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-32a57ba0-97a4-4567-9695-70d48076607a tempest-TestStampPattern-597707380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-b9a2cd7e-418f-42ea-a916-86e73dc61986" returned: 0 in 0.250s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-32a57ba0-97a4-4567-9695-70d48076607a tempest-TestStampPattern-597707380 None] Lock "cinder-quobyte-b9a2cd7e-418f-42ea-a916-86e73dc61986" released by "delete_volume" :: held 0.709s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:28 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-32a57ba0-97a4-4567-9695-70d48076607a tempest-TestStampPattern-597707380 None] Created reservations ['8c84fd63-963a-47ad-afeb-865713d677bd', '2345411d-ee94-4e43-8b30-8fde44070cb9', 'fd6aef21-9ada-4713-b90f-56b33521c15f', '0b25f92f-373e-4583-8561-9631d1dc82f6'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:57:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-32a57ba0-97a4-4567-9695-70d48076607a tempest-TestStampPattern-597707380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-32a57ba0-97a4-4567-9695-70d48076607a tempest-TestStampPattern-597707380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-32a57ba0-97a4-4567-9695-70d48076607a tempest-TestStampPattern-597707380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-32a57ba0-97a4-4567-9695-70d48076607a tempest-TestStampPattern-597707380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-32a57ba0-97a4-4567-9695-70d48076607a tempest-TestStampPattern-597707380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-32a57ba0-97a4-4567-9695-70d48076607a tempest-TestStampPattern-597707380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:28 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:57:28 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:28 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-32a57ba0-97a4-4567-9695-70d48076607a tempest-TestStampPattern-597707380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.348s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:28 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-32a57ba0-97a4-4567-9695-70d48076607a tempest-TestStampPattern-597707380 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:57:28 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-32a57ba0-97a4-4567-9695-70d48076607a tempest-TestStampPattern-597707380 None] Deleted volume successfully. Nov 02 10:57:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-32a57ba0-97a4-4567-9695-70d48076607a tempest-TestStampPattern-597707380 None] Lock "cinder-b9a2cd7e-418f-42ea-a916-86e73dc61986-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-6aa90f89-4663-4992-8a96-62e39d1542c8 req-cb910b5e-9488-4ad1-8065-2413bddafe42 tempest-TestServerVolumeAttachmentScenario-660481739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-6aa90f89-4663-4992-8a96-62e39d1542c8 req-cb910b5e-9488-4ad1-8065-2413bddafe42 tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-6aa90f89-4663-4992-8a96-62e39d1542c8 req-cb910b5e-9488-4ad1-8065-2413bddafe42 tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-6aa90f89-4663-4992-8a96-62e39d1542c8 req-cb910b5e-9488-4ad1-8065-2413bddafe42 tempest-TestServerVolumeAttachmentScenario-660481739 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235', 'name': 'volume-0a9b9e93-a444-4a94-b7ba-50c240717193', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec81fa71-2d59-4b37-a38c-8e767e69eb1d', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:57:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] Acquiring lock "cinder-68af72e4-1193-470b-9a8f-fa21d22b005b-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] Lock "cinder-68af72e4-1193-470b-9a8f-fa21d22b005b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] Acquiring lock "cinder-quobyte-aff332aa-719f-446c-9e11-cf81cbe7594b" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] Lock "cinder-quobyte-aff332aa-719f-446c-9e11-cf81cbe7594b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] Acquiring lock "cinder-quobyte-68af72e4-1193-470b-9a8f-fa21d22b005b" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-6aa90f89-4663-4992-8a96-62e39d1542c8 req-cb910b5e-9488-4ad1-8065-2413bddafe42 tempest-TestServerVolumeAttachmentScenario-660481739 None] attachment_update completed successfully. Nov 02 10:57:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] Lock "cinder-quobyte-68af72e4-1193-470b-9a8f-fa21d22b005b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] Deleting offline snapshot 68af72e4-1193-470b-9a8f-fa21d22b005b of volume aff332aa-719f-446c-9e11-cf81cbe7594b {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:57:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] snapshot_file for this snap is: volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:57:29 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1007e3-9e59-42ab-9d08-e17a970657bb]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:29 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b Nov 02 10:57:29 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:29 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b" returned: 0 in 0.418s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aff332aa-719f-446c-9e11-cf81cbe7594b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:57:29 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5493968-46fa-4b42-af18-e9b7abb9c132]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:29 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b Nov 02 10:57:29 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:30 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b" returned: 0 in 0.591s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:30 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b Nov 02 10:57:30 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:30 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-05feb2e7-263f-40d8-8f2e-9f72eefdaf4f req-5da38cca-4e98-4fe9-9868-68477fc5a3d6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Terminate volume connection completed successfully. Nov 02 10:57:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-05feb2e7-263f-40d8-8f2e-9f72eefdaf4f req-5da38cca-4e98-4fe9-9868-68477fc5a3d6 tempest-TestServerVolumeAttachmentScenario-660481739 None] Deleting attachment ec81fa71-2d59-4b37-a38c-8e767e69eb1d. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:57:30 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b" returned: 0 in 0.372s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:30 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b Nov 02 10:57:30 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:30 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b.68af72e4-1193-470b-9a8f-fa21d22b005b" returned: 0 in 0.247s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] Lock "cinder-quobyte-68af72e4-1193-470b-9a8f-fa21d22b005b" released by "_delete_snapshot" :: held 1.755s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] Lock "cinder-quobyte-aff332aa-719f-446c-9e11-cf81cbe7594b" released by "delete_snapshot" :: held 1.782s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:31 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] Created reservations ['89a21eef-38a7-48c9-beab-10235f14457c', '8abe38de-e78a-4556-8fb0-9469998f5164', '4f7ac7c5-cf9c-4961-a02a-61ce34e8a240', 'ddc51411-629a-4b76-aede-7d04174a50a5'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:57:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] Delete snapshot completed successfully. Nov 02 10:57:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39c82a52-db34-4d67-8b51-ccef054c43c5 tempest-TestStampPattern-597707380 None] Lock "cinder-68af72e4-1193-470b-9a8f-fa21d22b005b-delete_snapshot" released by "delete_snapshot" :: held 1.921s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:32 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-5d66503b-5a51-4576-bd37-27d527aa3901 req-8f0b1558-eae7-4d94-811a-8f929c3b37af tempest-TestServerVolumeAttachmentScenario-660481739 None] Terminate volume connection completed successfully. Nov 02 10:57:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-5d66503b-5a51-4576-bd37-27d527aa3901 req-8f0b1558-eae7-4d94-811a-8f929c3b37af tempest-TestServerVolumeAttachmentScenario-660481739 None] Deleting attachment 38fce3fa-9d6f-4284-8866-af9961aa6bae. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:57:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0017e5ae-d20d-4e0a-b414-ef5639644015 tempest-TestStampPattern-597707380 None] Acquiring lock "cinder-aff332aa-719f-446c-9e11-cf81cbe7594b-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0017e5ae-d20d-4e0a-b414-ef5639644015 tempest-TestStampPattern-597707380 None] Lock "cinder-aff332aa-719f-446c-9e11-cf81cbe7594b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0017e5ae-d20d-4e0a-b414-ef5639644015 tempest-TestStampPattern-597707380 None] Acquiring lock "cinder-quobyte-aff332aa-719f-446c-9e11-cf81cbe7594b" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0017e5ae-d20d-4e0a-b414-ef5639644015 tempest-TestStampPattern-597707380 None] Lock "cinder-quobyte-aff332aa-719f-446c-9e11-cf81cbe7594b" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:35 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed21fab-ee53-46e1-a523-7927ddae1df8]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0017e5ae-d20d-4e0a-b414-ef5639644015 tempest-TestStampPattern-597707380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:35 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b Nov 02 10:57:35 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:35 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0017e5ae-d20d-4e0a-b414-ef5639644015 tempest-TestStampPattern-597707380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b" returned: 0 in 0.408s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0017e5ae-d20d-4e0a-b414-ef5639644015 tempest-TestStampPattern-597707380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:35 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b Nov 02 10:57:35 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:36 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0017e5ae-d20d-4e0a-b414-ef5639644015 tempest-TestStampPattern-597707380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-aff332aa-719f-446c-9e11-cf81cbe7594b" returned: 0 in 0.262s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0017e5ae-d20d-4e0a-b414-ef5639644015 tempest-TestStampPattern-597707380 None] Lock "cinder-quobyte-aff332aa-719f-446c-9e11-cf81cbe7594b" released by "delete_volume" :: held 0.743s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:36 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-0017e5ae-d20d-4e0a-b414-ef5639644015 tempest-TestStampPattern-597707380 None] Created reservations ['b3afb5c5-114a-4615-afef-50fdfa32a161', 'ec62e8e5-3143-498e-a9a5-9effa203df5c', '3b9574a1-a18c-4f67-bffc-aeec347296a0', 'b9700376-6b4b-4649-a977-b37f34b2a51c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:57:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0017e5ae-d20d-4e0a-b414-ef5639644015 tempest-TestStampPattern-597707380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0017e5ae-d20d-4e0a-b414-ef5639644015 tempest-TestStampPattern-597707380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0017e5ae-d20d-4e0a-b414-ef5639644015 tempest-TestStampPattern-597707380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0017e5ae-d20d-4e0a-b414-ef5639644015 tempest-TestStampPattern-597707380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0017e5ae-d20d-4e0a-b414-ef5639644015 tempest-TestStampPattern-597707380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0017e5ae-d20d-4e0a-b414-ef5639644015 tempest-TestStampPattern-597707380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:36 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:57:36 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:36 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0017e5ae-d20d-4e0a-b414-ef5639644015 tempest-TestStampPattern-597707380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.296s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:36 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-0017e5ae-d20d-4e0a-b414-ef5639644015 tempest-TestStampPattern-597707380 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:57:36 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0017e5ae-d20d-4e0a-b414-ef5639644015 tempest-TestStampPattern-597707380 None] Deleted volume successfully. Nov 02 10:57:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0017e5ae-d20d-4e0a-b414-ef5639644015 tempest-TestStampPattern-597707380 None] Lock "cinder-aff332aa-719f-446c-9e11-cf81cbe7594b-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-325d7959-d4c6-4213-b3a5-c7131752a4f2 tempest-TestServerVolumeAttachmentScenario-660481739 None] Acquiring lock "cinder-0a9b9e93-a444-4a94-b7ba-50c240717193-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-325d7959-d4c6-4213-b3a5-c7131752a4f2 tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "cinder-0a9b9e93-a444-4a94-b7ba-50c240717193-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-325d7959-d4c6-4213-b3a5-c7131752a4f2 tempest-TestServerVolumeAttachmentScenario-660481739 None] Acquiring lock "cinder-quobyte-0a9b9e93-a444-4a94-b7ba-50c240717193" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-325d7959-d4c6-4213-b3a5-c7131752a4f2 tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "cinder-quobyte-0a9b9e93-a444-4a94-b7ba-50c240717193" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:37 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[53163ae3-a690-489e-ba25-25903f3b154d]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-325d7959-d4c6-4213-b3a5-c7131752a4f2 tempest-TestServerVolumeAttachmentScenario-660481739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0a9b9e93-a444-4a94-b7ba-50c240717193 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:37 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0a9b9e93-a444-4a94-b7ba-50c240717193 Nov 02 10:57:37 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:37 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-325d7959-d4c6-4213-b3a5-c7131752a4f2 tempest-TestServerVolumeAttachmentScenario-660481739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0a9b9e93-a444-4a94-b7ba-50c240717193" returned: 0 in 0.447s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-325d7959-d4c6-4213-b3a5-c7131752a4f2 tempest-TestServerVolumeAttachmentScenario-660481739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0a9b9e93-a444-4a94-b7ba-50c240717193 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:37 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0a9b9e93-a444-4a94-b7ba-50c240717193 Nov 02 10:57:37 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:38 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-325d7959-d4c6-4213-b3a5-c7131752a4f2 tempest-TestServerVolumeAttachmentScenario-660481739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0a9b9e93-a444-4a94-b7ba-50c240717193" returned: 0 in 0.276s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-325d7959-d4c6-4213-b3a5-c7131752a4f2 tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "cinder-quobyte-0a9b9e93-a444-4a94-b7ba-50c240717193" released by "delete_volume" :: held 0.780s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:38 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-325d7959-d4c6-4213-b3a5-c7131752a4f2 tempest-TestServerVolumeAttachmentScenario-660481739 None] Created reservations ['0c47ba4c-02b3-44f7-a35c-b907986abe31', '59b09149-ce4d-4fcd-bc30-4eafd5264049', '10c96ce6-a454-4e62-b5ea-7b8cccd4a678', 'b8ed6f3d-95f0-49ea-96a7-384068755ffc'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:57:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-325d7959-d4c6-4213-b3a5-c7131752a4f2 tempest-TestServerVolumeAttachmentScenario-660481739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-325d7959-d4c6-4213-b3a5-c7131752a4f2 tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-325d7959-d4c6-4213-b3a5-c7131752a4f2 tempest-TestServerVolumeAttachmentScenario-660481739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-325d7959-d4c6-4213-b3a5-c7131752a4f2 tempest-TestServerVolumeAttachmentScenario-660481739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-325d7959-d4c6-4213-b3a5-c7131752a4f2 tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-325d7959-d4c6-4213-b3a5-c7131752a4f2 tempest-TestServerVolumeAttachmentScenario-660481739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:38 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:57:38 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-43c32b60-3acf-42ae-be12-280a4d90894f tempest-TestServerVolumeAttachmentScenario-660481739 None] Acquiring lock "cinder-06e6dd9b-3a82-4746-954b-8a60404065a6-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-43c32b60-3acf-42ae-be12-280a4d90894f tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "cinder-06e6dd9b-3a82-4746-954b-8a60404065a6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-43c32b60-3acf-42ae-be12-280a4d90894f tempest-TestServerVolumeAttachmentScenario-660481739 None] Acquiring lock "cinder-quobyte-06e6dd9b-3a82-4746-954b-8a60404065a6" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:38 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-43c32b60-3acf-42ae-be12-280a4d90894f tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "cinder-quobyte-06e6dd9b-3a82-4746-954b-8a60404065a6" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-325d7959-d4c6-4213-b3a5-c7131752a4f2 tempest-TestServerVolumeAttachmentScenario-660481739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.384s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:38 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-325d7959-d4c6-4213-b3a5-c7131752a4f2 tempest-TestServerVolumeAttachmentScenario-660481739 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:57:38 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-325d7959-d4c6-4213-b3a5-c7131752a4f2 tempest-TestServerVolumeAttachmentScenario-660481739 None] Deleted volume successfully. Nov 02 10:57:38 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4785cd81-7efd-4ad1-9df5-fce7b7053962]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43c32b60-3acf-42ae-be12-280a4d90894f tempest-TestServerVolumeAttachmentScenario-660481739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-06e6dd9b-3a82-4746-954b-8a60404065a6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-325d7959-d4c6-4213-b3a5-c7131752a4f2 tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "cinder-0a9b9e93-a444-4a94-b7ba-50c240717193-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:38 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-06e6dd9b-3a82-4746-954b-8a60404065a6 Nov 02 10:57:38 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:39 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43c32b60-3acf-42ae-be12-280a4d90894f tempest-TestServerVolumeAttachmentScenario-660481739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-06e6dd9b-3a82-4746-954b-8a60404065a6" returned: 0 in 0.415s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43c32b60-3acf-42ae-be12-280a4d90894f tempest-TestServerVolumeAttachmentScenario-660481739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-06e6dd9b-3a82-4746-954b-8a60404065a6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:39 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-06e6dd9b-3a82-4746-954b-8a60404065a6 Nov 02 10:57:39 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:39 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43c32b60-3acf-42ae-be12-280a4d90894f tempest-TestServerVolumeAttachmentScenario-660481739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-06e6dd9b-3a82-4746-954b-8a60404065a6" returned: 0 in 0.258s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-43c32b60-3acf-42ae-be12-280a4d90894f tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "cinder-quobyte-06e6dd9b-3a82-4746-954b-8a60404065a6" released by "delete_volume" :: held 0.738s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:39 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-43c32b60-3acf-42ae-be12-280a4d90894f tempest-TestServerVolumeAttachmentScenario-660481739 None] Created reservations ['743f3a52-3617-424b-8a07-f71618b5fac3', '56606493-826b-4c05-8d76-841cbff53257', '67ff07f8-6e70-4238-893a-95c177e94cde', '8afb767c-710b-4047-8bd5-ffb57e16118b'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:57:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-43c32b60-3acf-42ae-be12-280a4d90894f tempest-TestServerVolumeAttachmentScenario-660481739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-43c32b60-3acf-42ae-be12-280a4d90894f tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-43c32b60-3acf-42ae-be12-280a4d90894f tempest-TestServerVolumeAttachmentScenario-660481739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-43c32b60-3acf-42ae-be12-280a4d90894f tempest-TestServerVolumeAttachmentScenario-660481739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-43c32b60-3acf-42ae-be12-280a4d90894f tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43c32b60-3acf-42ae-be12-280a4d90894f tempest-TestServerVolumeAttachmentScenario-660481739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:39 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:57:39 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:39 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43c32b60-3acf-42ae-be12-280a4d90894f tempest-TestServerVolumeAttachmentScenario-660481739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.341s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:39 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-43c32b60-3acf-42ae-be12-280a4d90894f tempest-TestServerVolumeAttachmentScenario-660481739 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:57:39 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-43c32b60-3acf-42ae-be12-280a4d90894f tempest-TestServerVolumeAttachmentScenario-660481739 None] Deleted volume successfully. Nov 02 10:57:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-43c32b60-3acf-42ae-be12-280a4d90894f tempest-TestServerVolumeAttachmentScenario-660481739 None] Lock "cinder-06e6dd9b-3a82-4746-954b-8a60404065a6-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:49 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=43,cinder:UPDATE=35,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:57:49 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=53,cinder:UPDATE=49,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Flow 'volume_create_manager' (b98b4c65-d17b-4cf2-a16b-eca3aec1ecdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4a54c1-6658-4904-a1ac-a87b9df74d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4a54c1-6658-4904-a1ac-a87b9df74d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-579117061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff074a0a3c5e42b6a257e3a931181b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:51Z,use_quota=True,user_id='fd47c500e3ec4dc9b3242143a5716504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869b79d4-44c4-4b37-8721-1cbd229c413c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869b79d4-44c4-4b37-8721-1cbd229c413c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410f390e-aeb0-4b43-ba8c-bcdccdd2ae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410f390e-aeb0-4b43-ba8c-bcdccdd2ae8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f', 'volume_name': 'volume-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3420459e-b6ca-4c9a-bc10-57d6b345743e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3420459e-b6ca-4c9a-bc10-57d6b345743e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99835f2f-cbe0-4ac9-b919-982304847315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:50 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Volume 7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f', 'volume_size': 1} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-579117061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff074a0a3c5e42b6a257e3a931181b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:51Z,use_quota=True,user_id='fd47c500e3ec4dc9b3242143a5716504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Creating volume 7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:57:50 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:57:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:50 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f 1073741824 Nov 02 10:57:50 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:51 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f 1073741824" returned: 0 in 0.441s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:51 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f Nov 02 10:57:51 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:51 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f" returned: 0 in 0.234s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:57:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99835f2f-cbe0-4ac9-b919-982304847315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d734c727-796b-4206-b43c-a6baeb11b53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:51 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Volume volume-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f (7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f): created successfully Nov 02 10:57:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d734c727-796b-4206-b43c-a6baeb11b53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Flow 'volume_create_manager' (b98b4c65-d17b-4cf2-a16b-eca3aec1ecdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:51 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-60a7de8b-b100-4b65-a6ca-37e1ea396e7d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Created volume successfully. Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Flow 'volume_create_manager' (de1a67b3-9267-436d-8bc4-80fc27d64159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3315f5-4581-4cee-beb5-35e7058ab4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3315f5-4581-4cee-beb5-35e7058ab4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-279760271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1047a677-8ff3-406e-84ff-f9b308d579ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff074a0a3c5e42b6a257e3a931181b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:52Z,use_quota=True,user_id='fd47c500e3ec4dc9b3242143a5716504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e6eb21-ef54-4f68-a8d6-8554e6339a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e6eb21-ef54-4f68-a8d6-8554e6339a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9acc00-5061-4ad7-9de1-a894dfd53b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9acc00-5061-4ad7-9de1-a894dfd53b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1047a677-8ff3-406e-84ff-f9b308d579ec', 'volume_name': 'volume-1047a677-8ff3-406e-84ff-f9b308d579ec', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af44b5ae-87dc-45be-bfd8-0d2d6346ab51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af44b5ae-87dc-45be-bfd8-0d2d6346ab51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711903f8-e0b8-4d39-b5e8-af778073ed3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:52 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Volume 1047a677-8ff3-406e-84ff-f9b308d579ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1047a677-8ff3-406e-84ff-f9b308d579ec', 'volume_size': 1} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-279760271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1047a677-8ff3-406e-84ff-f9b308d579ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff074a0a3c5e42b6a257e3a931181b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:52Z,use_quota=True,user_id='fd47c500e3ec4dc9b3242143a5716504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Creating volume 1047a677-8ff3-406e-84ff-f9b308d579ec {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:57:52 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1047a677-8ff3-406e-84ff-f9b308d579ec 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:52 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1047a677-8ff3-406e-84ff-f9b308d579ec 1073741824 Nov 02 10:57:52 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Flow 'volume_create_manager' (e0854c98-54f8-43db-b6b6-014fcd769de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4705c71-6657-4270-9a3c-c143a7a1a49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4705c71-6657-4270-9a3c-c143a7a1a49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1602765688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0206328c-0641-48a3-a82e-2a0a948b89c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff074a0a3c5e42b6a257e3a931181b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:53Z,use_quota=True,user_id='fd47c500e3ec4dc9b3242143a5716504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8884748-6567-41cc-a23c-11b249804b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8884748-6567-41cc-a23c-11b249804b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef5fae9d-e237-4143-a97a-3c35e04a2030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef5fae9d-e237-4143-a97a-3c35e04a2030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0206328c-0641-48a3-a82e-2a0a948b89c6', 'volume_name': 'volume-0206328c-0641-48a3-a82e-2a0a948b89c6', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8460a8d6-3f44-4449-b8a4-ec566ccd1f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8460a8d6-3f44-4449-b8a4-ec566ccd1f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05652887-d10d-41ca-b93f-49e196708bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:52 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Volume 0206328c-0641-48a3-a82e-2a0a948b89c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0206328c-0641-48a3-a82e-2a0a948b89c6', 'volume_size': 1} Nov 02 10:57:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:53 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1047a677-8ff3-406e-84ff-f9b308d579ec 1073741824" returned: 0 in 0.675s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:53 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:57:53 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1047a677-8ff3-406e-84ff-f9b308d579ec {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:53 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1047a677-8ff3-406e-84ff-f9b308d579ec Nov 02 10:57:53 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Flow 'volume_create_manager' (7a5d31a7-3689-4f4d-881a-3f0ea050b6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d1c200-0146-4c04-9598-4d1729043e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d1c200-0146-4c04-9598-4d1729043e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1422250093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=393a1c92-3f66-45e3-993c-600a938c82f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff074a0a3c5e42b6a257e3a931181b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:53Z,use_quota=True,user_id='fd47c500e3ec4dc9b3242143a5716504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2dfe87d-8c16-4271-8a05-5583b92ce14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2dfe87d-8c16-4271-8a05-5583b92ce14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c3931b7-be9d-4eca-a407-642865972513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c3931b7-be9d-4eca-a407-642865972513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '393a1c92-3f66-45e3-993c-600a938c82f6', 'volume_name': 'volume-393a1c92-3f66-45e3-993c-600a938c82f6', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e6fa9d-3fe1-402c-9b9c-01608ec6a5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e6fa9d-3fe1-402c-9b9c-01608ec6a5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ad393f-264c-49fb-9169-2c6502c94876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:53 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Volume 393a1c92-3f66-45e3-993c-600a938c82f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-393a1c92-3f66-45e3-993c-600a938c82f6', 'volume_size': 1} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:53 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.427s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:57:53 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1047a677-8ff3-406e-84ff-f9b308d579ec" returned: 0 in 0.410s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.679s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1602765688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0206328c-0641-48a3-a82e-2a0a948b89c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff074a0a3c5e42b6a257e3a931181b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:53Z,use_quota=True,user_id='fd47c500e3ec4dc9b3242143a5716504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Creating volume 0206328c-0641-48a3-a82e-2a0a948b89c6 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:57:53 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0206328c-0641-48a3-a82e-2a0a948b89c6 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:53 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0206328c-0641-48a3-a82e-2a0a948b89c6 1073741824 Nov 02 10:57:53 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711903f8-e0b8-4d39-b5e8-af778073ed3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1047a677-8ff3-406e-84ff-f9b308d579ec', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89863d4-f346-4918-b51f-2abcfb22d446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:53 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Volume volume-1047a677-8ff3-406e-84ff-f9b308d579ec (1047a677-8ff3-406e-84ff-f9b308d579ec): created successfully Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89863d4-f346-4918-b51f-2abcfb22d446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Flow 'volume_create_manager' (de1a67b3-9267-436d-8bc4-80fc27d64159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:53 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-52d3cee2-d02a-44de-b33a-a1b1c419aae2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Created volume successfully. Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Flow 'volume_create_manager' (c54b5d4e-f43e-4b3e-a4c4-064508da6370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa6a0b5-8447-418a-96b9-2fbf5c639b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa6a0b5-8447-418a-96b9-2fbf5c639b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-279257543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2ef8c0-549b-4fe7-a02e-2149f62941f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff074a0a3c5e42b6a257e3a931181b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:54Z,use_quota=True,user_id='fd47c500e3ec4dc9b3242143a5716504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0653236-4887-4ffd-b359-63f36018403f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0653236-4887-4ffd-b359-63f36018403f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (242b74de-8131-4f22-99e3-f9004edd2211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (242b74de-8131-4f22-99e3-f9004edd2211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c2ef8c0-549b-4fe7-a02e-2149f62941f3', 'volume_name': 'volume-5c2ef8c0-549b-4fe7-a02e-2149f62941f3', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6139b047-5427-4814-95dd-d37ac680c6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6139b047-5427-4814-95dd-d37ac680c6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb57ec6a-c1bc-4b9f-8326-75be4e5e4146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:53 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Volume 5c2ef8c0-549b-4fe7-a02e-2149f62941f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c2ef8c0-549b-4fe7-a02e-2149f62941f3', 'volume_size': 1} Nov 02 10:57:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Flow 'volume_create_manager' (5b99c10d-e620-46ad-b5ae-e1d7954c6f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:54 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b113b1-c6ce-4f4d-bfd9-dd3b0fd2545d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0206328c-0641-48a3-a82e-2a0a948b89c6 1073741824" returned: 0 in 0.647s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b113b1-c6ce-4f4d-bfd9-dd3b0fd2545d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1848042570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10907334-d88a-429e-b40e-a7864638e801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff074a0a3c5e42b6a257e3a931181b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:54Z,use_quota=True,user_id='fd47c500e3ec4dc9b3242143a5716504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3bc835-49ea-467f-af53-975738813742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3bc835-49ea-467f-af53-975738813742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad6d517-e613-46fd-af86-506bcef98b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad6d517-e613-46fd-af86-506bcef98b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10907334-d88a-429e-b40e-a7864638e801', 'volume_name': 'volume-10907334-d88a-429e-b40e-a7864638e801', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb3d159-645d-4204-b8e5-38bdb0ff1d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb3d159-645d-4204-b8e5-38bdb0ff1d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (585fc22b-e008-47b1-91f6-d09e33b39008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:54 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Volume 10907334-d88a-429e-b40e-a7864638e801: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10907334-d88a-429e-b40e-a7864638e801', 'volume_size': 1} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0206328c-0641-48a3-a82e-2a0a948b89c6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:54 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0206328c-0641-48a3-a82e-2a0a948b89c6 Nov 02 10:57:54 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:54 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0206328c-0641-48a3-a82e-2a0a948b89c6" returned: 0 in 0.254s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.214s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1422250093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=393a1c92-3f66-45e3-993c-600a938c82f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff074a0a3c5e42b6a257e3a931181b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:53Z,use_quota=True,user_id='fd47c500e3ec4dc9b3242143a5716504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Creating volume 393a1c92-3f66-45e3-993c-600a938c82f6 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:57:54 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-393a1c92-3f66-45e3-993c-600a938c82f6 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:54 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-393a1c92-3f66-45e3-993c-600a938c82f6 1073741824 Nov 02 10:57:54 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05652887-d10d-41ca-b93f-49e196708bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0206328c-0641-48a3-a82e-2a0a948b89c6', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a623a1-abcd-4e12-a575-23b0a2534045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:54 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Volume volume-0206328c-0641-48a3-a82e-2a0a948b89c6 (0206328c-0641-48a3-a82e-2a0a948b89c6): created successfully Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a623a1-abcd-4e12-a575-23b0a2534045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Flow 'volume_create_manager' (e0854c98-54f8-43db-b6b6-014fcd769de7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a6fbcda8-7962-4945-8724-e96bdcf7a67b tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Created volume successfully. Nov 02 10:57:55 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-393a1c92-3f66-45e3-993c-600a938c82f6 1073741824" returned: 0 in 0.498s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-393a1c92-3f66-45e3-993c-600a938c82f6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:55 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-393a1c92-3f66-45e3-993c-600a938c82f6 Nov 02 10:57:55 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:55 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-393a1c92-3f66-45e3-993c-600a938c82f6" returned: 0 in 0.291s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.509s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-279257543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2ef8c0-549b-4fe7-a02e-2149f62941f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff074a0a3c5e42b6a257e3a931181b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:54Z,use_quota=True,user_id='fd47c500e3ec4dc9b3242143a5716504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Creating volume 5c2ef8c0-549b-4fe7-a02e-2149f62941f3 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:57:55 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5c2ef8c0-549b-4fe7-a02e-2149f62941f3 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:55 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5c2ef8c0-549b-4fe7-a02e-2149f62941f3 1073741824 Nov 02 10:57:55 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ad393f-264c-49fb-9169-2c6502c94876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-393a1c92-3f66-45e3-993c-600a938c82f6', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f97026-d55e-4ae1-ad6d-8eb1627b295d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:55 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Volume volume-393a1c92-3f66-45e3-993c-600a938c82f6 (393a1c92-3f66-45e3-993c-600a938c82f6): created successfully Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f97026-d55e-4ae1-ad6d-8eb1627b295d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Flow 'volume_create_manager' (7a5d31a7-3689-4f4d-881a-3f0ea050b6d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:55 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b0fdb543-1882-4c4f-ab9c-b8309ff4b010 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Created volume successfully. Nov 02 10:57:55 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5c2ef8c0-549b-4fe7-a02e-2149f62941f3 1073741824" returned: 0 in 0.518s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5c2ef8c0-549b-4fe7-a02e-2149f62941f3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:56 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5c2ef8c0-549b-4fe7-a02e-2149f62941f3 Nov 02 10:57:56 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:56 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5c2ef8c0-549b-4fe7-a02e-2149f62941f3" returned: 0 in 0.266s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:57:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.967s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1848042570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10907334-d88a-429e-b40e-a7864638e801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff074a0a3c5e42b6a257e3a931181b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:54Z,use_quota=True,user_id='fd47c500e3ec4dc9b3242143a5716504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:57:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Creating volume 10907334-d88a-429e-b40e-a7864638e801 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:57:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:57:56 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:57:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-10907334-d88a-429e-b40e-a7864638e801 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:56 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-10907334-d88a-429e-b40e-a7864638e801 1073741824 Nov 02 10:57:56 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb57ec6a-c1bc-4b9f-8326-75be4e5e4146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c2ef8c0-549b-4fe7-a02e-2149f62941f3', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02b1b555-bc77-49c2-8e48-31b1781b7516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:56 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Volume volume-5c2ef8c0-549b-4fe7-a02e-2149f62941f3 (5c2ef8c0-549b-4fe7-a02e-2149f62941f3): created successfully Nov 02 10:57:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02b1b555-bc77-49c2-8e48-31b1781b7516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Flow 'volume_create_manager' (c54b5d4e-f43e-4b3e-a4c4-064508da6370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:56 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1f70a185-0e1b-4be4-9444-fb78bd9e5c42 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Created volume successfully. Nov 02 10:57:56 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-10907334-d88a-429e-b40e-a7864638e801 1073741824" returned: 0 in 0.438s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-10907334-d88a-429e-b40e-a7864638e801 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:56 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-10907334-d88a-429e-b40e-a7864638e801 Nov 02 10:57:56 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:57 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-10907334-d88a-429e-b40e-a7864638e801" returned: 0 in 0.267s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:57:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (585fc22b-e008-47b1-91f6-d09e33b39008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10907334-d88a-429e-b40e-a7864638e801', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abd1001f-95ae-4ddb-b9ec-84ffc73d7887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:57 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Volume volume-10907334-d88a-429e-b40e-a7864638e801 (10907334-d88a-429e-b40e-a7864638e801): created successfully Nov 02 10:57:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abd1001f-95ae-4ddb-b9ec-84ffc73d7887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Flow 'volume_create_manager' (5b99c10d-e620-46ad-b5ae-e1d7954c6f9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-69262110-f019-40bc-bc52-3150111a3659 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Created volume successfully. Nov 02 10:57:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c431735-6bfe-4f29-856b-b7d27a64ff63 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "cinder-10907334-d88a-429e-b40e-a7864638e801-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c431735-6bfe-4f29-856b-b7d27a64ff63 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-10907334-d88a-429e-b40e-a7864638e801-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c431735-6bfe-4f29-856b-b7d27a64ff63 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "cinder-quobyte-10907334-d88a-429e-b40e-a7864638e801" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c431735-6bfe-4f29-856b-b7d27a64ff63 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-quobyte-10907334-d88a-429e-b40e-a7864638e801" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:57 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25434ba-24d1-41e5-9775-60159e8191a7]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4c431735-6bfe-4f29-856b-b7d27a64ff63 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-10907334-d88a-429e-b40e-a7864638e801 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:57 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-10907334-d88a-429e-b40e-a7864638e801 Nov 02 10:57:57 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:58 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4c431735-6bfe-4f29-856b-b7d27a64ff63 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-10907334-d88a-429e-b40e-a7864638e801" returned: 0 in 0.351s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4c431735-6bfe-4f29-856b-b7d27a64ff63 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-10907334-d88a-429e-b40e-a7864638e801 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:58 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-10907334-d88a-429e-b40e-a7864638e801 Nov 02 10:57:58 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:58 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4c431735-6bfe-4f29-856b-b7d27a64ff63 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-10907334-d88a-429e-b40e-a7864638e801" returned: 0 in 0.248s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c431735-6bfe-4f29-856b-b7d27a64ff63 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-quobyte-10907334-d88a-429e-b40e-a7864638e801" released by "delete_volume" :: held 0.645s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:58 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-4c431735-6bfe-4f29-856b-b7d27a64ff63 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Created reservations ['cd6cddab-7d27-40c2-8df0-20a212bc6a3d', '3966062e-feaf-47d9-848b-fab5cd34246c', 'f49322f7-be58-4eb9-98b5-3f7e4561168c', '1473d4ff-fc1b-4b08-af2a-23a0cb835f38'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:57:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4c431735-6bfe-4f29-856b-b7d27a64ff63 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4c431735-6bfe-4f29-856b-b7d27a64ff63 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4c431735-6bfe-4f29-856b-b7d27a64ff63 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4c431735-6bfe-4f29-856b-b7d27a64ff63 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4c431735-6bfe-4f29-856b-b7d27a64ff63 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4c431735-6bfe-4f29-856b-b7d27a64ff63 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:58 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:57:58 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:58 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4c431735-6bfe-4f29-856b-b7d27a64ff63 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.275s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:58 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-4c431735-6bfe-4f29-856b-b7d27a64ff63 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:57:58 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4c431735-6bfe-4f29-856b-b7d27a64ff63 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Deleted volume successfully. Nov 02 10:57:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c431735-6bfe-4f29-856b-b7d27a64ff63 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-10907334-d88a-429e-b40e-a7864638e801-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2b3ae1dc-04ea-4489-97ba-3f36cf0b456d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "cinder-5c2ef8c0-549b-4fe7-a02e-2149f62941f3-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2b3ae1dc-04ea-4489-97ba-3f36cf0b456d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-5c2ef8c0-549b-4fe7-a02e-2149f62941f3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2b3ae1dc-04ea-4489-97ba-3f36cf0b456d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "cinder-quobyte-5c2ef8c0-549b-4fe7-a02e-2149f62941f3" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2b3ae1dc-04ea-4489-97ba-3f36cf0b456d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-quobyte-5c2ef8c0-549b-4fe7-a02e-2149f62941f3" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:58 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2663d4a-c617-47c7-aded-99fb3721914a]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2b3ae1dc-04ea-4489-97ba-3f36cf0b456d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5c2ef8c0-549b-4fe7-a02e-2149f62941f3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:58 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5c2ef8c0-549b-4fe7-a02e-2149f62941f3 Nov 02 10:57:58 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:59 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2b3ae1dc-04ea-4489-97ba-3f36cf0b456d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5c2ef8c0-549b-4fe7-a02e-2149f62941f3" returned: 0 in 0.357s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2b3ae1dc-04ea-4489-97ba-3f36cf0b456d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5c2ef8c0-549b-4fe7-a02e-2149f62941f3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:59 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5c2ef8c0-549b-4fe7-a02e-2149f62941f3 Nov 02 10:57:59 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:59 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2b3ae1dc-04ea-4489-97ba-3f36cf0b456d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5c2ef8c0-549b-4fe7-a02e-2149f62941f3" returned: 0 in 0.249s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2b3ae1dc-04ea-4489-97ba-3f36cf0b456d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-quobyte-5c2ef8c0-549b-4fe7-a02e-2149f62941f3" released by "delete_volume" :: held 0.651s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:59 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-2b3ae1dc-04ea-4489-97ba-3f36cf0b456d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Created reservations ['fbc7682c-2ce2-4c5c-95cd-5838babe9973', '57aea9cd-2d29-4e0f-a472-d44dc50ea642', 'ae200fc7-6988-432a-a8ab-f7243ed327d9', 'e5e1f498-81aa-419f-a5f9-c0bacb1ba4e9'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:57:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2b3ae1dc-04ea-4489-97ba-3f36cf0b456d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2b3ae1dc-04ea-4489-97ba-3f36cf0b456d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2b3ae1dc-04ea-4489-97ba-3f36cf0b456d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2b3ae1dc-04ea-4489-97ba-3f36cf0b456d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2b3ae1dc-04ea-4489-97ba-3f36cf0b456d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2b3ae1dc-04ea-4489-97ba-3f36cf0b456d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:59 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:57:59 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:59 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2b3ae1dc-04ea-4489-97ba-3f36cf0b456d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.260s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:59 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-2b3ae1dc-04ea-4489-97ba-3f36cf0b456d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:57:59 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2b3ae1dc-04ea-4489-97ba-3f36cf0b456d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Deleted volume successfully. Nov 02 10:57:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2b3ae1dc-04ea-4489-97ba-3f36cf0b456d tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-5c2ef8c0-549b-4fe7-a02e-2149f62941f3-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-22941084-fc87-4908-95f6-945a9aef38cd tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "cinder-393a1c92-3f66-45e3-993c-600a938c82f6-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-22941084-fc87-4908-95f6-945a9aef38cd tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-393a1c92-3f66-45e3-993c-600a938c82f6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-22941084-fc87-4908-95f6-945a9aef38cd tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "cinder-quobyte-393a1c92-3f66-45e3-993c-600a938c82f6" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-22941084-fc87-4908-95f6-945a9aef38cd tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-quobyte-393a1c92-3f66-45e3-993c-600a938c82f6" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:00 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dabbcf-f66d-4592-8f75-f976bf29ca5f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-22941084-fc87-4908-95f6-945a9aef38cd tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-393a1c92-3f66-45e3-993c-600a938c82f6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:00 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-393a1c92-3f66-45e3-993c-600a938c82f6 Nov 02 10:58:00 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:00 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-22941084-fc87-4908-95f6-945a9aef38cd tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-393a1c92-3f66-45e3-993c-600a938c82f6" returned: 0 in 0.379s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-22941084-fc87-4908-95f6-945a9aef38cd tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-393a1c92-3f66-45e3-993c-600a938c82f6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:00 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-393a1c92-3f66-45e3-993c-600a938c82f6 Nov 02 10:58:00 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:00 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-22941084-fc87-4908-95f6-945a9aef38cd tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-393a1c92-3f66-45e3-993c-600a938c82f6" returned: 0 in 0.279s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-22941084-fc87-4908-95f6-945a9aef38cd tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-quobyte-393a1c92-3f66-45e3-993c-600a938c82f6" released by "delete_volume" :: held 0.700s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:00 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-22941084-fc87-4908-95f6-945a9aef38cd tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Created reservations ['24d481c4-2878-4182-89de-9099d2ca4ca1', '1231d834-b99a-4231-8ccd-05dab373164b', 'a2a02a86-d171-4b68-9ee6-48bbae7dca4a', 'daaa7bc3-a0a2-4187-91a8-e4d0c89f7663'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:58:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-22941084-fc87-4908-95f6-945a9aef38cd tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-22941084-fc87-4908-95f6-945a9aef38cd tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-22941084-fc87-4908-95f6-945a9aef38cd tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-22941084-fc87-4908-95f6-945a9aef38cd tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-22941084-fc87-4908-95f6-945a9aef38cd tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-22941084-fc87-4908-95f6-945a9aef38cd tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:00 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:58:00 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:01 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-22941084-fc87-4908-95f6-945a9aef38cd tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.259s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:01 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-22941084-fc87-4908-95f6-945a9aef38cd tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:01 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-22941084-fc87-4908-95f6-945a9aef38cd tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Deleted volume successfully. Nov 02 10:58:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c09645d6-2e2b-4f90-8d09-b35abc0151c8 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "cinder-0206328c-0641-48a3-a82e-2a0a948b89c6-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-22941084-fc87-4908-95f6-945a9aef38cd tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-393a1c92-3f66-45e3-993c-600a938c82f6-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c09645d6-2e2b-4f90-8d09-b35abc0151c8 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-0206328c-0641-48a3-a82e-2a0a948b89c6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c09645d6-2e2b-4f90-8d09-b35abc0151c8 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "cinder-quobyte-0206328c-0641-48a3-a82e-2a0a948b89c6" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c09645d6-2e2b-4f90-8d09-b35abc0151c8 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-quobyte-0206328c-0641-48a3-a82e-2a0a948b89c6" acquired by "delete_volume" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:01 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c5146d-6632-4e06-a944-c22a3d047bce]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c09645d6-2e2b-4f90-8d09-b35abc0151c8 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0206328c-0641-48a3-a82e-2a0a948b89c6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:01 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0206328c-0641-48a3-a82e-2a0a948b89c6 Nov 02 10:58:01 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:01 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c09645d6-2e2b-4f90-8d09-b35abc0151c8 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0206328c-0641-48a3-a82e-2a0a948b89c6" returned: 0 in 0.395s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c09645d6-2e2b-4f90-8d09-b35abc0151c8 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0206328c-0641-48a3-a82e-2a0a948b89c6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:01 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0206328c-0641-48a3-a82e-2a0a948b89c6 Nov 02 10:58:01 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:01 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c09645d6-2e2b-4f90-8d09-b35abc0151c8 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0206328c-0641-48a3-a82e-2a0a948b89c6" returned: 0 in 0.271s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c09645d6-2e2b-4f90-8d09-b35abc0151c8 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-quobyte-0206328c-0641-48a3-a82e-2a0a948b89c6" released by "delete_volume" :: held 0.710s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:01 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c09645d6-2e2b-4f90-8d09-b35abc0151c8 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Created reservations ['bebbfbd6-de06-43f0-813d-7f7783abc1cf', '5a948fed-878c-4e10-be67-a48dbf8bb969', '4de43926-02d5-4488-ac21-74f4a113de46', '5c139804-41c0-44b7-9b56-33ccc7fe6966'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:58:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c09645d6-2e2b-4f90-8d09-b35abc0151c8 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c09645d6-2e2b-4f90-8d09-b35abc0151c8 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c09645d6-2e2b-4f90-8d09-b35abc0151c8 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c09645d6-2e2b-4f90-8d09-b35abc0151c8 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c09645d6-2e2b-4f90-8d09-b35abc0151c8 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c09645d6-2e2b-4f90-8d09-b35abc0151c8 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:02 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:58:02 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:02 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c09645d6-2e2b-4f90-8d09-b35abc0151c8 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.244s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:02 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c09645d6-2e2b-4f90-8d09-b35abc0151c8 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:02 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c09645d6-2e2b-4f90-8d09-b35abc0151c8 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Deleted volume successfully. Nov 02 10:58:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d742b14-1f36-4b9d-a5be-61575e84fef2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "cinder-1047a677-8ff3-406e-84ff-f9b308d579ec-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d742b14-1f36-4b9d-a5be-61575e84fef2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-1047a677-8ff3-406e-84ff-f9b308d579ec-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c09645d6-2e2b-4f90-8d09-b35abc0151c8 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-0206328c-0641-48a3-a82e-2a0a948b89c6-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d742b14-1f36-4b9d-a5be-61575e84fef2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "cinder-quobyte-1047a677-8ff3-406e-84ff-f9b308d579ec" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d742b14-1f36-4b9d-a5be-61575e84fef2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-quobyte-1047a677-8ff3-406e-84ff-f9b308d579ec" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:02 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8669f39-cfe7-44bc-af85-b431239e1e42]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d742b14-1f36-4b9d-a5be-61575e84fef2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1047a677-8ff3-406e-84ff-f9b308d579ec {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:02 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1047a677-8ff3-406e-84ff-f9b308d579ec Nov 02 10:58:02 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:02 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d742b14-1f36-4b9d-a5be-61575e84fef2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1047a677-8ff3-406e-84ff-f9b308d579ec" returned: 0 in 0.351s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d742b14-1f36-4b9d-a5be-61575e84fef2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1047a677-8ff3-406e-84ff-f9b308d579ec {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:02 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1047a677-8ff3-406e-84ff-f9b308d579ec Nov 02 10:58:02 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:02 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d742b14-1f36-4b9d-a5be-61575e84fef2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1047a677-8ff3-406e-84ff-f9b308d579ec" returned: 0 in 0.238s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d742b14-1f36-4b9d-a5be-61575e84fef2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-quobyte-1047a677-8ff3-406e-84ff-f9b308d579ec" released by "delete_volume" :: held 0.632s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:03 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-6d742b14-1f36-4b9d-a5be-61575e84fef2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Created reservations ['991064fd-946a-42f9-8775-e63ee61d7daa', 'c3902d3e-88b3-4ea8-86c1-d9567c3c5559', '74f6d293-f8e2-4a23-8d5b-764b365c15d1', 'b03a92d0-832d-431c-8fcb-6e83797c482a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:58:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6d742b14-1f36-4b9d-a5be-61575e84fef2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6d742b14-1f36-4b9d-a5be-61575e84fef2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6d742b14-1f36-4b9d-a5be-61575e84fef2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6d742b14-1f36-4b9d-a5be-61575e84fef2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6d742b14-1f36-4b9d-a5be-61575e84fef2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d742b14-1f36-4b9d-a5be-61575e84fef2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:03 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:58:03 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:03 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d742b14-1f36-4b9d-a5be-61575e84fef2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.270s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:03 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-6d742b14-1f36-4b9d-a5be-61575e84fef2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6d742b14-1f36-4b9d-a5be-61575e84fef2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Deleted volume successfully. Nov 02 10:58:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d742b14-1f36-4b9d-a5be-61575e84fef2 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-1047a677-8ff3-406e-84ff-f9b308d579ec-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b9c4aae4-5565-468d-9087-63125d4dfb30 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "cinder-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b9c4aae4-5565-468d-9087-63125d4dfb30 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b9c4aae4-5565-468d-9087-63125d4dfb30 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "cinder-quobyte-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b9c4aae4-5565-468d-9087-63125d4dfb30 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-quobyte-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:03 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec881ac6-93cc-4700-b2f9-e9952fa0c7ba]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b9c4aae4-5565-468d-9087-63125d4dfb30 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:03 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f Nov 02 10:58:03 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:03 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b9c4aae4-5565-468d-9087-63125d4dfb30 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f" returned: 0 in 0.408s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b9c4aae4-5565-468d-9087-63125d4dfb30 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:03 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f Nov 02 10:58:03 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:04 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b9c4aae4-5565-468d-9087-63125d4dfb30 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f" returned: 0 in 0.236s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b9c4aae4-5565-468d-9087-63125d4dfb30 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-quobyte-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f" released by "delete_volume" :: held 0.694s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:04 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-b9c4aae4-5565-468d-9087-63125d4dfb30 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Created reservations ['e595be8c-efba-40e6-b996-deb81f5e2773', 'b495b0e7-1630-4124-9962-675e74a007bd', '5ef3b41e-30ed-434e-8868-7a0f3e3f0abd', '4c68d409-b7b1-44c9-82fb-ee5b963f979f'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:58:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b9c4aae4-5565-468d-9087-63125d4dfb30 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b9c4aae4-5565-468d-9087-63125d4dfb30 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b9c4aae4-5565-468d-9087-63125d4dfb30 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b9c4aae4-5565-468d-9087-63125d4dfb30 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b9c4aae4-5565-468d-9087-63125d4dfb30 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b9c4aae4-5565-468d-9087-63125d4dfb30 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:04 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:58:04 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:04 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b9c4aae4-5565-468d-9087-63125d4dfb30 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.245s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:04 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b9c4aae4-5565-468d-9087-63125d4dfb30 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:04 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b9c4aae4-5565-468d-9087-63125d4dfb30 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Deleted volume successfully. Nov 02 10:58:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b9c4aae4-5565-468d-9087-63125d4dfb30 tempest-CreateVolumesFromSourceVolumeTest-2134661074 None] Lock "cinder-7c61fbe7-d48c-48a1-9afb-1a0bdcf4430f-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:09 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Flow 'volume_create_manager' (b3ee4cb7-d7e5-4d78-b7a8-66d75f7333d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42cbc8e8-26b2-4fb2-bc20-e4b59f35eb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42cbc8e8-26b2-4fb2-bc20-e4b59f35eb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcdd7593-7988-4828-8831-aad7fe79a1bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dc7f0013984a7182c10f0483611998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:10Z,use_quota=True,user_id='d59052cffb974c27b15c30d1d8ada5bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f4ca72-e1cb-421d-9306-f9c3e2d9df21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f4ca72-e1cb-421d-9306-f9c3e2d9df21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ee49c7-3afc-45d7-bdf9-33f9088fe83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:09 devstack cinder-volume[87084]: DEBUG cinder.image.glance [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Creating Keystone auth plugin from conf {{(pid=87084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:58:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ee49c7-3afc-45d7-bdf9-33f9088fe83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fcdd7593-7988-4828-8831-aad7fe79a1bb', 'volume_name': 'volume-fcdd7593-7988-4828-8831-aad7fe79a1bb', 'volume_size': 1, 'image_id': 'd090766d-2b54-4b06-909b-9b9354206442', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d090766d-2b54-4b06-909b-9b9354206442', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2dc9b1bfdfc1d93dfa9d7b49ccb28e03', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e0dc7f0013984a7182c10f0483611998', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fdadd2fc1db1a085ec6a9983e3be69c2ab1e5c33e9694ff0e1ead15eaf349da7c9f4b75017039d1ac34c2e8084c5a8697971476bfb8025e40c6b6229285905e2', 'id': 'd090766d-2b54-4b06-909b-9b9354206442', 'created_at': datetime.datetime(2026, 11, 2, 9, 58, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 58, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d090766d-2b54-4b06-909b-9b9354206442/file', 'properties': {}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da746af-0448-4c26-8b4d-66bb81f6958e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da746af-0448-4c26-8b4d-66bb81f6958e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1a29b2-420b-41c8-8b80-330c114defc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:10 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Volume fcdd7593-7988-4828-8831-aad7fe79a1bb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fcdd7593-7988-4828-8831-aad7fe79a1bb', 'volume_size': 1, 'image_id': 'd090766d-2b54-4b06-909b-9b9354206442', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d090766d-2b54-4b06-909b-9b9354206442', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2dc9b1bfdfc1d93dfa9d7b49ccb28e03', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e0dc7f0013984a7182c10f0483611998', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fdadd2fc1db1a085ec6a9983e3be69c2ab1e5c33e9694ff0e1ead15eaf349da7c9f4b75017039d1ac34c2e8084c5a8697971476bfb8025e40c6b6229285905e2', 'id': 'd090766d-2b54-4b06-909b-9b9354206442', 'created_at': datetime.datetime(2026, 11, 2, 9, 58, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 58, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d090766d-2b54-4b06-909b-9b9354206442/file', 'properties': {}}, 'image_service': } Nov 02 10:58:10 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Trying to clone fcdd7593-7988-4828-8831-aad7fe79a1bb from image d090766d-2b54-4b06-909b-9b9354206442 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d090766d-2b54-4b06-909b-9b9354206442', 'metadata': {}}]). {{(pid=87084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:58:10 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:58:10 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Image download 0.00 MB at 0.00 MB/s Nov 02 10:58:10 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8c59c5-5ea7-4d08-8539-e1b7ef7f269f]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:10 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD Nov 02 10:58:10 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:10 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD" returned: 0 in 0.312s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:10 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD Nov 02 10:58:10 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:10 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD" returned: 1 in 0.310s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:58:10 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Temporary image d090766d-2b54-4b06-909b-9b9354206442 is fetched for user d59052cffb974c27b15c30d1d8ada5bb. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:58:10 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e510a03-f524-4b48-9261-2982efa35e69]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:10 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD Nov 02 10:58:10 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:11 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:11 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD Nov 02 10:58:11 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:11 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:58:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcdd7593-7988-4828-8831-aad7fe79a1bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dc7f0013984a7182c10f0483611998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:10Z,use_quota=True,user_id='d59052cffb974c27b15c30d1d8ada5bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Creating volume fcdd7593-7988-4828-8831-aad7fe79a1bb {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:11 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fcdd7593-7988-4828-8831-aad7fe79a1bb 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:11 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fcdd7593-7988-4828-8831-aad7fe79a1bb 1073741824 Nov 02 10:58:11 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:11 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fcdd7593-7988-4828-8831-aad7fe79a1bb 1073741824" returned: 0 in 0.413s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fcdd7593-7988-4828-8831-aad7fe79a1bb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:12 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fcdd7593-7988-4828-8831-aad7fe79a1bb Nov 02 10:58:12 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:12 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fcdd7593-7988-4828-8831-aad7fe79a1bb" returned: 0 in 0.240s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:12 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Attempting download of d090766d-2b54-4b06-909b-9b9354206442 ((None, [{'url': 'file:///opt/stack/data/glance/images/d090766d-2b54-4b06-909b-9b9354206442', 'metadata': {}}])) to volume fcdd7593-7988-4828-8831-aad7fe79a1bb. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:58:12 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1aa1b38-f47c-44c6-a1a9-a0625e880463]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d090766d-2b54-4b06-909b-9b9354206442_na8dvbvh {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:12 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d090766d-2b54-4b06-909b-9b9354206442_na8dvbvh Nov 02 10:58:12 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:12 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d090766d-2b54-4b06-909b-9b9354206442_na8dvbvh" returned: 0 in 0.319s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090766d-2b54-4b06-909b-9b9354206442_na8dvbvh {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:12 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090766d-2b54-4b06-909b-9b9354206442_na8dvbvh Nov 02 10:58:12 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:12 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090766d-2b54-4b06-909b-9b9354206442_na8dvbvh" returned: 1 in 0.320s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090766d-2b54-4b06-909b-9b9354206442_na8dvbvh' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:58:12 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a902b0-ec41-412c-a50a-1db0b6126b84]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:13 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD Nov 02 10:58:13 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:13 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:13 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD Nov 02 10:58:13 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:13 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD" returned: 1 in 0.362s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:58:13 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] d090766d-2b54-4b06-909b-9b9354206442 was raw, converting to qcow2 {{(pid=87084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:58:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fcdd7593-7988-4828-8831-aad7fe79a1bb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:13 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fcdd7593-7988-4828-8831-aad7fe79a1bb Nov 02 10:58:13 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:14 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fcdd7593-7988-4828-8831-aad7fe79a1bb" returned: 0 in 0.427s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:14 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d090766d-2b54-4b06-909b-9b9354206442_qgzoifxjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fcdd7593-7988-4828-8831-aad7fe79a1bb {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:58:14 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 10:58:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fcdd7593-7988-4828-8831-aad7fe79a1bb 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:14 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fcdd7593-7988-4828-8831-aad7fe79a1bb 1G Nov 02 10:58:14 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:14 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fcdd7593-7988-4828-8831-aad7fe79a1bb 1G" returned: 0 in 0.306s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:14 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Downloaded image d090766d-2b54-4b06-909b-9b9354206442 ((None, [{'url': 'file:///opt/stack/data/glance/images/d090766d-2b54-4b06-909b-9b9354206442', 'metadata': {}}])) to volume fcdd7593-7988-4828-8831-aad7fe79a1bb successfully. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:58:14 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Temporary image d090766d-2b54-4b06-909b-9b9354206442 for user d59052cffb974c27b15c30d1d8ada5bb is deleted. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:58:14 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Marking volume fcdd7593-7988-4828-8831-aad7fe79a1bb as bootable. {{(pid=87084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:58:14 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Copying metadata from image d090766d-2b54-4b06-909b-9b9354206442 to fcdd7593-7988-4828-8831-aad7fe79a1bb. {{(pid=87084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:58:14 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Creating volume glance metadata for volume fcdd7593-7988-4828-8831-aad7fe79a1bb backed by image d090766d-2b54-4b06-909b-9b9354206442 with: {'image_id': 'd090766d-2b54-4b06-909b-9b9354206442', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2dc9b1bfdfc1d93dfa9d7b49ccb28e03', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:58:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1a29b2-420b-41c8-8b80-330c114defc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcdd7593-7988-4828-8831-aad7fe79a1bb', 'volume_size': 1, 'image_id': 'd090766d-2b54-4b06-909b-9b9354206442', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d090766d-2b54-4b06-909b-9b9354206442', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2dc9b1bfdfc1d93dfa9d7b49ccb28e03', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e0dc7f0013984a7182c10f0483611998', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fdadd2fc1db1a085ec6a9983e3be69c2ab1e5c33e9694ff0e1ead15eaf349da7c9f4b75017039d1ac34c2e8084c5a8697971476bfb8025e40c6b6229285905e2', 'id': 'd090766d-2b54-4b06-909b-9b9354206442', 'created_at': datetime.datetime(2026, 11, 2, 9, 58, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 58, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d090766d-2b54-4b06-909b-9b9354206442/file', 'properties': {}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52dc4008-b958-4491-9236-45fa7821c8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:14 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Volume volume-fcdd7593-7988-4828-8831-aad7fe79a1bb (fcdd7593-7988-4828-8831-aad7fe79a1bb): created successfully Nov 02 10:58:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52dc4008-b958-4491-9236-45fa7821c8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Flow 'volume_create_manager' (b3ee4cb7-d7e5-4d78-b7a8-66d75f7333d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-90ff9485-9bbe-460f-b3aa-a48653914307 tempest-VolumeImageDependencyTests-1126961365 None] Created volume successfully. Nov 02 10:58:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4656c2d6-85c9-4d6f-844a-233943088d21 tempest-VolumeImageDependencyTests-1126961365 None] Acquiring lock "cinder-fcdd7593-7988-4828-8831-aad7fe79a1bb-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4656c2d6-85c9-4d6f-844a-233943088d21 tempest-VolumeImageDependencyTests-1126961365 None] Lock "cinder-fcdd7593-7988-4828-8831-aad7fe79a1bb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4656c2d6-85c9-4d6f-844a-233943088d21 tempest-VolumeImageDependencyTests-1126961365 None] Acquiring lock "cinder-quobyte-fcdd7593-7988-4828-8831-aad7fe79a1bb" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4656c2d6-85c9-4d6f-844a-233943088d21 tempest-VolumeImageDependencyTests-1126961365 None] Lock "cinder-quobyte-fcdd7593-7988-4828-8831-aad7fe79a1bb" acquired by "delete_volume" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:15 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c3a8ee-5fd4-4ca8-b57b-bc0055d7f277]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4656c2d6-85c9-4d6f-844a-233943088d21 tempest-VolumeImageDependencyTests-1126961365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fcdd7593-7988-4828-8831-aad7fe79a1bb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:15 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fcdd7593-7988-4828-8831-aad7fe79a1bb Nov 02 10:58:15 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:15 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4656c2d6-85c9-4d6f-844a-233943088d21 tempest-VolumeImageDependencyTests-1126961365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fcdd7593-7988-4828-8831-aad7fe79a1bb" returned: 0 in 0.374s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4656c2d6-85c9-4d6f-844a-233943088d21 tempest-VolumeImageDependencyTests-1126961365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fcdd7593-7988-4828-8831-aad7fe79a1bb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:15 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fcdd7593-7988-4828-8831-aad7fe79a1bb Nov 02 10:58:15 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:15 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4656c2d6-85c9-4d6f-844a-233943088d21 tempest-VolumeImageDependencyTests-1126961365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fcdd7593-7988-4828-8831-aad7fe79a1bb" returned: 0 in 0.240s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4656c2d6-85c9-4d6f-844a-233943088d21 tempest-VolumeImageDependencyTests-1126961365 None] Lock "cinder-quobyte-fcdd7593-7988-4828-8831-aad7fe79a1bb" released by "delete_volume" :: held 0.651s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:15 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-4656c2d6-85c9-4d6f-844a-233943088d21 tempest-VolumeImageDependencyTests-1126961365 None] Created reservations ['76d410ea-d2d8-48f2-9fb7-037386146ef0', 'ca95abef-3593-4363-9a93-db9e6912e78d', 'd882927e-7140-4951-9dce-3aaef4b98444', '489668df-7a6b-4eff-86fa-8fde0c96a0ed'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:58:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4656c2d6-85c9-4d6f-844a-233943088d21 tempest-VolumeImageDependencyTests-1126961365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4656c2d6-85c9-4d6f-844a-233943088d21 tempest-VolumeImageDependencyTests-1126961365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4656c2d6-85c9-4d6f-844a-233943088d21 tempest-VolumeImageDependencyTests-1126961365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4656c2d6-85c9-4d6f-844a-233943088d21 tempest-VolumeImageDependencyTests-1126961365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4656c2d6-85c9-4d6f-844a-233943088d21 tempest-VolumeImageDependencyTests-1126961365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4656c2d6-85c9-4d6f-844a-233943088d21 tempest-VolumeImageDependencyTests-1126961365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:15 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:58:15 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:16 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4656c2d6-85c9-4d6f-844a-233943088d21 tempest-VolumeImageDependencyTests-1126961365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.236s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:16 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-4656c2d6-85c9-4d6f-844a-233943088d21 tempest-VolumeImageDependencyTests-1126961365 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:16 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4656c2d6-85c9-4d6f-844a-233943088d21 tempest-VolumeImageDependencyTests-1126961365 None] Deleted volume successfully. Nov 02 10:58:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4656c2d6-85c9-4d6f-844a-233943088d21 tempest-VolumeImageDependencyTests-1126961365 None] Lock "cinder-fcdd7593-7988-4828-8831-aad7fe79a1bb-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Flow 'volume_create_manager' (be9e6381-84d5-4e33-af53-57c71dd534aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8fc850-8ace-414a-8d58-3b1f8d197b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8fc850-8ace-414a-8d58-3b1f8d197b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-92583193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5258b4e4-3df1-482c-b701-2819df67896a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22be384402c48598514510a71bf96a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:20Z,use_quota=True,user_id='f6399053ab0b496286616e1e2d65a6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987ef24b-8e11-48f2-80fb-6efcf7b1a6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987ef24b-8e11-48f2-80fb-6efcf7b1a6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669bf3b4-ef08-49f5-b9b7-d776a2818769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669bf3b4-ef08-49f5-b9b7-d776a2818769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5258b4e4-3df1-482c-b701-2819df67896a', 'volume_name': 'volume-5258b4e4-3df1-482c-b701-2819df67896a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a39d59-88c0-4e18-93ae-ac3095c5729e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a39d59-88c0-4e18-93ae-ac3095c5729e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fad9cc-4a4a-46f1-9eee-e4af395628dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:19 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Volume 5258b4e4-3df1-482c-b701-2819df67896a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5258b4e4-3df1-482c-b701-2819df67896a', 'volume_size': 1} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-92583193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5258b4e4-3df1-482c-b701-2819df67896a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22be384402c48598514510a71bf96a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:20Z,use_quota=True,user_id='f6399053ab0b496286616e1e2d65a6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Creating volume 5258b4e4-3df1-482c-b701-2819df67896a {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:19 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5258b4e4-3df1-482c-b701-2819df67896a 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:19 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5258b4e4-3df1-482c-b701-2819df67896a 1073741824 Nov 02 10:58:19 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:20 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5258b4e4-3df1-482c-b701-2819df67896a 1073741824" returned: 0 in 0.408s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5258b4e4-3df1-482c-b701-2819df67896a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:20 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5258b4e4-3df1-482c-b701-2819df67896a Nov 02 10:58:20 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:20 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5258b4e4-3df1-482c-b701-2819df67896a" returned: 0 in 0.258s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fad9cc-4a4a-46f1-9eee-e4af395628dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5258b4e4-3df1-482c-b701-2819df67896a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d16b9cf-bdbc-4fd9-b588-2d117b04e77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:20 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Volume volume-5258b4e4-3df1-482c-b701-2819df67896a (5258b4e4-3df1-482c-b701-2819df67896a): created successfully Nov 02 10:58:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d16b9cf-bdbc-4fd9-b588-2d117b04e77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Flow 'volume_create_manager' (be9e6381-84d5-4e33-af53-57c71dd534aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:20 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-03d0f6c4-57ae-402f-99f3-0940eda538c9 tempest-ProjectReaderTests-357891571 None] Created volume successfully. Nov 02 10:58:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1643255c-ecb0-445e-99e2-a5551d1fcfbe tempest-ProjectReaderTests-357891571 None] Acquiring lock "cinder-5258b4e4-3df1-482c-b701-2819df67896a-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1643255c-ecb0-445e-99e2-a5551d1fcfbe tempest-ProjectReaderTests-357891571 None] Lock "cinder-5258b4e4-3df1-482c-b701-2819df67896a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1643255c-ecb0-445e-99e2-a5551d1fcfbe tempest-ProjectReaderTests-357891571 None] Acquiring lock "cinder-quobyte-5258b4e4-3df1-482c-b701-2819df67896a" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1643255c-ecb0-445e-99e2-a5551d1fcfbe tempest-ProjectReaderTests-357891571 None] Lock "cinder-quobyte-5258b4e4-3df1-482c-b701-2819df67896a" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:21 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2ca5ec-193f-4897-832f-1723e1f94ad5]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1643255c-ecb0-445e-99e2-a5551d1fcfbe tempest-ProjectReaderTests-357891571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5258b4e4-3df1-482c-b701-2819df67896a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:21 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5258b4e4-3df1-482c-b701-2819df67896a Nov 02 10:58:21 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:21 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1643255c-ecb0-445e-99e2-a5551d1fcfbe tempest-ProjectReaderTests-357891571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5258b4e4-3df1-482c-b701-2819df67896a" returned: 0 in 0.350s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1643255c-ecb0-445e-99e2-a5551d1fcfbe tempest-ProjectReaderTests-357891571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5258b4e4-3df1-482c-b701-2819df67896a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:21 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5258b4e4-3df1-482c-b701-2819df67896a Nov 02 10:58:21 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:21 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1643255c-ecb0-445e-99e2-a5551d1fcfbe tempest-ProjectReaderTests-357891571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-5258b4e4-3df1-482c-b701-2819df67896a" returned: 0 in 0.244s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1643255c-ecb0-445e-99e2-a5551d1fcfbe tempest-ProjectReaderTests-357891571 None] Lock "cinder-quobyte-5258b4e4-3df1-482c-b701-2819df67896a" released by "delete_volume" :: held 0.636s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:21 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-1643255c-ecb0-445e-99e2-a5551d1fcfbe tempest-ProjectReaderTests-357891571 None] Created reservations ['c67bc813-d0a7-4d9f-b802-b4cc8653be80', '5064b685-dc30-404d-a13c-07af6db97f18', '0b7fb19d-125c-4f6f-a52d-8151ae7c4b12', 'da688a79-7a6e-4847-a532-d47dbf81b8cc'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:58:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1643255c-ecb0-445e-99e2-a5551d1fcfbe tempest-ProjectReaderTests-357891571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1643255c-ecb0-445e-99e2-a5551d1fcfbe tempest-ProjectReaderTests-357891571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1643255c-ecb0-445e-99e2-a5551d1fcfbe tempest-ProjectReaderTests-357891571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1643255c-ecb0-445e-99e2-a5551d1fcfbe tempest-ProjectReaderTests-357891571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1643255c-ecb0-445e-99e2-a5551d1fcfbe tempest-ProjectReaderTests-357891571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1643255c-ecb0-445e-99e2-a5551d1fcfbe tempest-ProjectReaderTests-357891571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:21 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:58:21 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:22 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1643255c-ecb0-445e-99e2-a5551d1fcfbe tempest-ProjectReaderTests-357891571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.235s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-1643255c-ecb0-445e-99e2-a5551d1fcfbe tempest-ProjectReaderTests-357891571 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:22 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1643255c-ecb0-445e-99e2-a5551d1fcfbe tempest-ProjectReaderTests-357891571 None] Deleted volume successfully. Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1643255c-ecb0-445e-99e2-a5551d1fcfbe tempest-ProjectReaderTests-357891571 None] Lock "cinder-5258b4e4-3df1-482c-b701-2819df67896a-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Flow 'volume_create_manager' (34d94273-0c68-440b-9473-8b1959264fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5523ba8d-be89-404a-8ec0-a934c107ced1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5523ba8d-be89-404a-8ec0-a934c107ced1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1479405858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d84a30-e490-4d27-b35e-d55375fb476e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22be384402c48598514510a71bf96a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:23Z,use_quota=True,user_id='f6399053ab0b496286616e1e2d65a6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caadfd6c-e28e-4b79-bf8c-ae9f716e9500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caadfd6c-e28e-4b79-bf8c-ae9f716e9500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e920c950-14ea-4b69-9974-1dcf1f9242e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e920c950-14ea-4b69-9974-1dcf1f9242e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00d84a30-e490-4d27-b35e-d55375fb476e', 'volume_name': 'volume-00d84a30-e490-4d27-b35e-d55375fb476e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7effb4-2dc3-4cc4-8532-a96eb4674e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7effb4-2dc3-4cc4-8532-a96eb4674e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3747ed3d-a365-4407-94d7-1ee0b8fa8da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:22 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Volume 00d84a30-e490-4d27-b35e-d55375fb476e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00d84a30-e490-4d27-b35e-d55375fb476e', 'volume_size': 1} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1479405858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d84a30-e490-4d27-b35e-d55375fb476e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22be384402c48598514510a71bf96a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:23Z,use_quota=True,user_id='f6399053ab0b496286616e1e2d65a6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Creating volume 00d84a30-e490-4d27-b35e-d55375fb476e {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:22 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-00d84a30-e490-4d27-b35e-d55375fb476e 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:22 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-00d84a30-e490-4d27-b35e-d55375fb476e 1073741824 Nov 02 10:58:22 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:23 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-00d84a30-e490-4d27-b35e-d55375fb476e 1073741824" returned: 0 in 0.420s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-00d84a30-e490-4d27-b35e-d55375fb476e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:23 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-00d84a30-e490-4d27-b35e-d55375fb476e Nov 02 10:58:23 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:23 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-00d84a30-e490-4d27-b35e-d55375fb476e" returned: 0 in 0.234s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3747ed3d-a365-4407-94d7-1ee0b8fa8da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00d84a30-e490-4d27-b35e-d55375fb476e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5acccb96-d594-4a52-8141-9f0b6a3fdcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:23 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Volume volume-00d84a30-e490-4d27-b35e-d55375fb476e (00d84a30-e490-4d27-b35e-d55375fb476e): created successfully Nov 02 10:58:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5acccb96-d594-4a52-8141-9f0b6a3fdcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Flow 'volume_create_manager' (34d94273-0c68-440b-9473-8b1959264fee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-cbd1b89c-a144-4d6c-ae29-0457a24411a9 tempest-ProjectReaderTests-357891571 None] Created volume successfully. Nov 02 10:58:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-92044606-fdbe-40b1-a744-11ec6cb4ab56 tempest-ProjectReaderTests-357891571 None] Acquiring lock "cinder-00d84a30-e490-4d27-b35e-d55375fb476e-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-92044606-fdbe-40b1-a744-11ec6cb4ab56 tempest-ProjectReaderTests-357891571 None] Lock "cinder-00d84a30-e490-4d27-b35e-d55375fb476e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-92044606-fdbe-40b1-a744-11ec6cb4ab56 tempest-ProjectReaderTests-357891571 None] Acquiring lock "cinder-quobyte-00d84a30-e490-4d27-b35e-d55375fb476e" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-92044606-fdbe-40b1-a744-11ec6cb4ab56 tempest-ProjectReaderTests-357891571 None] Lock "cinder-quobyte-00d84a30-e490-4d27-b35e-d55375fb476e" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:23 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c35b9b8-72c9-4055-a0c2-c511db37497d]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-92044606-fdbe-40b1-a744-11ec6cb4ab56 tempest-ProjectReaderTests-357891571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-00d84a30-e490-4d27-b35e-d55375fb476e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:23 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-00d84a30-e490-4d27-b35e-d55375fb476e Nov 02 10:58:23 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:24 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-92044606-fdbe-40b1-a744-11ec6cb4ab56 tempest-ProjectReaderTests-357891571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-00d84a30-e490-4d27-b35e-d55375fb476e" returned: 0 in 0.355s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-92044606-fdbe-40b1-a744-11ec6cb4ab56 tempest-ProjectReaderTests-357891571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-00d84a30-e490-4d27-b35e-d55375fb476e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:24 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-00d84a30-e490-4d27-b35e-d55375fb476e Nov 02 10:58:24 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:24 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-92044606-fdbe-40b1-a744-11ec6cb4ab56 tempest-ProjectReaderTests-357891571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-00d84a30-e490-4d27-b35e-d55375fb476e" returned: 0 in 0.248s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-92044606-fdbe-40b1-a744-11ec6cb4ab56 tempest-ProjectReaderTests-357891571 None] Lock "cinder-quobyte-00d84a30-e490-4d27-b35e-d55375fb476e" released by "delete_volume" :: held 0.644s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:24 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-92044606-fdbe-40b1-a744-11ec6cb4ab56 tempest-ProjectReaderTests-357891571 None] Created reservations ['16583976-5e87-4963-b9b2-274a1f592cbe', '07862825-0f7a-4431-b63c-13825faaf914', '57ff6516-8106-4104-9d6e-ec6cdce8c644', '38cb9fba-f082-481d-bd89-136f1779ec5a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:58:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-92044606-fdbe-40b1-a744-11ec6cb4ab56 tempest-ProjectReaderTests-357891571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-92044606-fdbe-40b1-a744-11ec6cb4ab56 tempest-ProjectReaderTests-357891571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-92044606-fdbe-40b1-a744-11ec6cb4ab56 tempest-ProjectReaderTests-357891571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-92044606-fdbe-40b1-a744-11ec6cb4ab56 tempest-ProjectReaderTests-357891571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-92044606-fdbe-40b1-a744-11ec6cb4ab56 tempest-ProjectReaderTests-357891571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-92044606-fdbe-40b1-a744-11ec6cb4ab56 tempest-ProjectReaderTests-357891571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:24 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:58:24 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:24 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-92044606-fdbe-40b1-a744-11ec6cb4ab56 tempest-ProjectReaderTests-357891571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.238s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:24 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-92044606-fdbe-40b1-a744-11ec6cb4ab56 tempest-ProjectReaderTests-357891571 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:24 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-92044606-fdbe-40b1-a744-11ec6cb4ab56 tempest-ProjectReaderTests-357891571 None] Deleted volume successfully. Nov 02 10:58:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-92044606-fdbe-40b1-a744-11ec6cb4ab56 tempest-ProjectReaderTests-357891571 None] Lock "cinder-00d84a30-e490-4d27-b35e-d55375fb476e-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:34 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=74,cinder:UPDATE=100,cinder:INSERT=24,cinder:DELETE=8 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:58:34 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=101,cinder:SELECT=63,cinder:DELETE=10,cinder:INSERT=30 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Flow 'volume_create_manager' (8c3bb562-318e-419e-bbbf-3e553e7c772f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ec5077-54ec-4a22-b795-b5b78915bc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ec5077-54ec-4a22-b795-b5b78915bc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1017178638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7596164a-58cd-469a-b947-ba9365d8c4aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7bdd2e85c584998acc1d8d1bbf4453b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:37Z,use_quota=True,user_id='08ccbea1d7764508b0dd0f42d0cb1240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909f42fe-d52b-4f5b-b6a2-65a27ad372d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909f42fe-d52b-4f5b-b6a2-65a27ad372d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37549e9-aba2-40b8-b497-11d467582177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37549e9-aba2-40b8-b497-11d467582177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7596164a-58cd-469a-b947-ba9365d8c4aa', 'volume_name': 'volume-7596164a-58cd-469a-b947-ba9365d8c4aa', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d375ac1c-2b5d-4f43-929d-510f489b167f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d375ac1c-2b5d-4f43-929d-510f489b167f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d635a0a-4272-4126-a8b3-15da6f097b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:36 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Volume 7596164a-58cd-469a-b947-ba9365d8c4aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7596164a-58cd-469a-b947-ba9365d8c4aa', 'volume_size': 1} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1017178638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7596164a-58cd-469a-b947-ba9365d8c4aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7bdd2e85c584998acc1d8d1bbf4453b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:37Z,use_quota=True,user_id='08ccbea1d7764508b0dd0f42d0cb1240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Creating volume 7596164a-58cd-469a-b947-ba9365d8c4aa {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:36 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7596164a-58cd-469a-b947-ba9365d8c4aa 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:37 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7596164a-58cd-469a-b947-ba9365d8c4aa 1073741824 Nov 02 10:58:37 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Flow 'volume_create_manager' (8fd24c16-21f1-413b-bb7f-9027eea8193c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1fbd444-1655-4187-9646-c3e1e09d7f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1fbd444-1655-4187-9646-c3e1e09d7f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1145669130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=960c8fff-5ac3-4cf4-bdd8-357899f434ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eee9eeb66bd4142a4b168cc5f0f37c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:37Z,use_quota=True,user_id='c79f5ee12f2f438f80e4f1eb8ed1b9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8b6395-2acd-44d1-9322-26ac1af2e83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8b6395-2acd-44d1-9322-26ac1af2e83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b29d09d-9d36-4065-95fa-74c57564f63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b29d09d-9d36-4065-95fa-74c57564f63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '960c8fff-5ac3-4cf4-bdd8-357899f434ae', 'volume_name': 'volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0533bcfb-c544-48b8-9b7c-8dd80aedd8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0533bcfb-c544-48b8-9b7c-8dd80aedd8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6d32a2-047d-4b43-a094-1faabe1b8758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:37 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Volume 960c8fff-5ac3-4cf4-bdd8-357899f434ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae', 'volume_size': 1} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Flow 'volume_create_manager' (b58a17d9-cea2-4e8d-a8b7-18db9fc3d943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:37 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895cd04c-8c35-4eb1-9d81-294bbb361611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7596164a-58cd-469a-b947-ba9365d8c4aa 1073741824" returned: 0 in 0.760s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895cd04c-8c35-4eb1-9d81-294bbb361611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-314477906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143b3001-a254-4677-806b-25ff03ca074a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55626cacbcd74e3f8d1b8cf6b5c4ab6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:37Z,use_quota=True,user_id='b0e4114c8def4e8da7c395509f715330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf9a1be-9442-4edf-8e8a-130acc321039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf9a1be-9442-4edf-8e8a-130acc321039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7bfe4f-500a-467e-a38f-de07d6d6dec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7bfe4f-500a-467e-a38f-de07d6d6dec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '143b3001-a254-4677-806b-25ff03ca074a', 'volume_name': 'volume-143b3001-a254-4677-806b-25ff03ca074a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ffd2ed-32bc-4399-997d-18f311b4c200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ffd2ed-32bc-4399-997d-18f311b4c200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc15377-fe5b-40d8-81f6-cfd54cd06d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:37 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Volume 143b3001-a254-4677-806b-25ff03ca074a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-143b3001-a254-4677-806b-25ff03ca074a', 'volume_size': 1} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Flow 'volume_create_manager' (9ee92625-a71a-4f55-bc28-62803488fb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc4b115-e59b-442f-962b-2916a752e654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7596164a-58cd-469a-b947-ba9365d8c4aa {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc4b115-e59b-442f-962b-2916a752e654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1100344346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9f75bb-c10c-4671-94c4-afb8282c670b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7bdd2e85c584998acc1d8d1bbf4453b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:38Z,use_quota=True,user_id='08ccbea1d7764508b0dd0f42d0cb1240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75de4fb6-aeb7-4804-9836-490f3fe2f377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75de4fb6-aeb7-4804-9836-490f3fe2f377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe30b48f-a6c6-4402-80e8-b103fe10f17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:38 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7596164a-58cd-469a-b947-ba9365d8c4aa Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe30b48f-a6c6-4402-80e8-b103fe10f17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b9f75bb-c10c-4671-94c4-afb8282c670b', 'volume_name': 'volume-0b9f75bb-c10c-4671-94c4-afb8282c670b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:38 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cdeb631-2325-467d-aae3-daa324bc8bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cdeb631-2325-467d-aae3-daa324bc8bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce38286d-58d3-42cf-a3af-4e0e06f51970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:38 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Volume 0b9f75bb-c10c-4671-94c4-afb8282c670b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b9f75bb-c10c-4671-94c4-afb8282c670b', 'volume_size': 1} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Flow 'volume_create_manager' (d1f8d71b-7637-4093-a5cb-4e2d35a94c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96bed054-ac7d-4500-803e-24e5bdec7ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96bed054-ac7d-4500-803e-24e5bdec7ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-684944680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4eee1f6-8e07-458d-879c-c8618d45c1dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7bdd2e85c584998acc1d8d1bbf4453b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:38Z,use_quota=True,user_id='08ccbea1d7764508b0dd0f42d0cb1240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52aef895-7776-439a-8cbd-52bf49abfa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52aef895-7776-439a-8cbd-52bf49abfa6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c167e887-aac1-4c77-b350-7ee7adf664d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c167e887-aac1-4c77-b350-7ee7adf664d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4eee1f6-8e07-458d-879c-c8618d45c1dd', 'volume_name': 'volume-f4eee1f6-8e07-458d-879c-c8618d45c1dd', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552e01aa-2324-47f7-a9ee-3601c5723554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552e01aa-2324-47f7-a9ee-3601c5723554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299db5ae-d21a-4a17-901d-0c2809a04842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:38 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Volume f4eee1f6-8e07-458d-879c-c8618d45c1dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4eee1f6-8e07-458d-879c-c8618d45c1dd', 'volume_size': 1} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:38 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7596164a-58cd-469a-b947-ba9365d8c4aa" returned: 0 in 0.324s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.180s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1145669130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=960c8fff-5ac3-4cf4-bdd8-357899f434ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eee9eeb66bd4142a4b168cc5f0f37c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:37Z,use_quota=True,user_id='c79f5ee12f2f438f80e4f1eb8ed1b9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Creating volume 960c8fff-5ac3-4cf4-bdd8-357899f434ae {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:38 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d635a0a-4272-4126-a8b3-15da6f097b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7596164a-58cd-469a-b947-ba9365d8c4aa', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426eabe4-00dd-4884-9f14-b2cc0b35a7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:38 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae 1073741824 Nov 02 10:58:38 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:38 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Volume volume-7596164a-58cd-469a-b947-ba9365d8c4aa (7596164a-58cd-469a-b947-ba9365d8c4aa): created successfully Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426eabe4-00dd-4884-9f14-b2cc0b35a7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Flow 'volume_create_manager' (8c3bb562-318e-419e-bbbf-3e553e7c772f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:38 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6c00d020-68e0-4cfa-b9ab-1c29a899719a tempest-CreateVolumesFromImageTest-1035926659 None] Created volume successfully. Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Flow 'volume_create_manager' (1daecd55-e16e-44a2-9a45-488678b9e106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0cbe117-8b8f-40aa-ac62-9590231f1f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0cbe117-8b8f-40aa-ac62-9590231f1f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-264368824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c1b564-d7b9-45ec-afe9-b72e2809185d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7bdd2e85c584998acc1d8d1bbf4453b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:38Z,use_quota=True,user_id='08ccbea1d7764508b0dd0f42d0cb1240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32961177-b5e9-4ac3-a902-6af13b655987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32961177-b5e9-4ac3-a902-6af13b655987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (890a5306-bf00-4172-9fb9-47a44539bfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (890a5306-bf00-4172-9fb9-47a44539bfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5c1b564-d7b9-45ec-afe9-b72e2809185d', 'volume_name': 'volume-d5c1b564-d7b9-45ec-afe9-b72e2809185d', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b1b3d7-ebd7-4499-b78d-da7621739875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b1b3d7-ebd7-4499-b78d-da7621739875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8f3883-bdb4-47fa-9560-e664d469941b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:38 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Volume d5c1b564-d7b9-45ec-afe9-b72e2809185d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5c1b564-d7b9-45ec-afe9-b72e2809185d', 'volume_size': 1} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:38 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:38 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Flow 'volume_create_manager' (accfefe2-8f7b-4a03-9d9b-e286456e2128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e87e4a8-5cb6-44c9-8b7a-f3a287653c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae 1073741824" returned: 0 in 0.647s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e87e4a8-5cb6-44c9-8b7a-f3a287653c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1229808522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825f96d6-1f26-4726-a6f1-d82bd5de8ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7bdd2e85c584998acc1d8d1bbf4453b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:39Z,use_quota=True,user_id='08ccbea1d7764508b0dd0f42d0cb1240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80731a87-fed3-4a06-af84-77d9b2c806b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80731a87-fed3-4a06-af84-77d9b2c806b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf578e4-848b-4457-b407-c8031afa0516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf578e4-848b-4457-b407-c8031afa0516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '825f96d6-1f26-4726-a6f1-d82bd5de8ea4', 'volume_name': 'volume-825f96d6-1f26-4726-a6f1-d82bd5de8ea4', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380ee5b6-2ac9-4ed2-949a-9d26defcbde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380ee5b6-2ac9-4ed2-949a-9d26defcbde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e405c9d5-7864-42cb-9c29-ffc1b8765d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Volume 825f96d6-1f26-4726-a6f1-d82bd5de8ea4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-825f96d6-1f26-4726-a6f1-d82bd5de8ea4', 'volume_size': 1} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:39 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae Nov 02 10:58:39 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:39 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae" returned: 0 in 0.251s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.427s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-314477906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143b3001-a254-4677-806b-25ff03ca074a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55626cacbcd74e3f8d1b8cf6b5c4ab6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:37Z,use_quota=True,user_id='b0e4114c8def4e8da7c395509f715330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Creating volume 143b3001-a254-4677-806b-25ff03ca074a {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:39 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-143b3001-a254-4677-806b-25ff03ca074a 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6d32a2-047d-4b43-a094-1faabe1b8758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8966c20-ebb0-4c9a-a02d-dccf71ebd8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:39 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-143b3001-a254-4677-806b-25ff03ca074a 1073741824 Nov 02 10:58:39 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Volume volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae (960c8fff-5ac3-4cf4-bdd8-357899f434ae): created successfully Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8966c20-ebb0-4c9a-a02d-dccf71ebd8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Flow 'volume_create_manager' (8fd24c16-21f1-413b-bb7f-9027eea8193c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:39 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0a6312c4-bcea-4be7-9b70-1c85f171de93 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Created volume successfully. Nov 02 10:58:39 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-143b3001-a254-4677-806b-25ff03ca074a 1073741824" returned: 0 in 0.454s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-143b3001-a254-4677-806b-25ff03ca074a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:39 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-143b3001-a254-4677-806b-25ff03ca074a Nov 02 10:58:39 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:40 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-143b3001-a254-4677-806b-25ff03ca074a" returned: 0 in 0.250s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.040s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1100344346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9f75bb-c10c-4671-94c4-afb8282c670b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7bdd2e85c584998acc1d8d1bbf4453b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:38Z,use_quota=True,user_id='08ccbea1d7764508b0dd0f42d0cb1240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Creating volume 0b9f75bb-c10c-4671-94c4-afb8282c670b {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:40 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0b9f75bb-c10c-4671-94c4-afb8282c670b 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc15377-fe5b-40d8-81f6-cfd54cd06d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-143b3001-a254-4677-806b-25ff03ca074a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418c7472-ecd4-4796-a4c1-feddc2c57674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:40 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0b9f75bb-c10c-4671-94c4-afb8282c670b 1073741824 Nov 02 10:58:40 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:40 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Volume volume-143b3001-a254-4677-806b-25ff03ca074a (143b3001-a254-4677-806b-25ff03ca074a): created successfully Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418c7472-ecd4-4796-a4c1-feddc2c57674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Flow 'volume_create_manager' (b58a17d9-cea2-4e8d-a8b7-18db9fc3d943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:40 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-74a22c67-8d99-4f37-bdc5-f3e90a053627 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Created volume successfully. Nov 02 10:58:40 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0b9f75bb-c10c-4671-94c4-afb8282c670b 1073741824" returned: 0 in 0.483s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0b9f75bb-c10c-4671-94c4-afb8282c670b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:40 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0b9f75bb-c10c-4671-94c4-afb8282c670b Nov 02 10:58:40 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4a34db79-3c0a-4623-8e7e-7389af8fd9c0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:40 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0b9f75bb-c10c-4671-94c4-afb8282c670b" returned: 0 in 0.283s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.630s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-684944680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4eee1f6-8e07-458d-879c-c8618d45c1dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7bdd2e85c584998acc1d8d1bbf4453b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:38Z,use_quota=True,user_id='08ccbea1d7764508b0dd0f42d0cb1240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Creating volume f4eee1f6-8e07-458d-879c-c8618d45c1dd {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:40 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f4eee1f6-8e07-458d-879c-c8618d45c1dd 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce38286d-58d3-42cf-a3af-4e0e06f51970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b9f75bb-c10c-4671-94c4-afb8282c670b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8dca28-5a41-47d8-96a1-32e176e1daaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:40 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f4eee1f6-8e07-458d-879c-c8618d45c1dd 1073741824 Nov 02 10:58:40 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:40 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Volume volume-0b9f75bb-c10c-4671-94c4-afb8282c670b (0b9f75bb-c10c-4671-94c4-afb8282c670b): created successfully Nov 02 10:58:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8dca28-5a41-47d8-96a1-32e176e1daaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Flow 'volume_create_manager' (9ee92625-a71a-4f55-bc28-62803488fb4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8e104d9a-9fa0-4bf7-810d-a9201801dec7 tempest-CreateVolumesFromImageTest-1035926659 None] Created volume successfully. Nov 02 10:58:41 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f4eee1f6-8e07-458d-879c-c8618d45c1dd 1073741824" returned: 0 in 0.522s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f4eee1f6-8e07-458d-879c-c8618d45c1dd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:41 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f4eee1f6-8e07-458d-879c-c8618d45c1dd Nov 02 10:58:41 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Flow 'volume_create_manager' (54352047-ecb1-4049-82b2-68e00d7fffdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9647712-096b-43c2-90a0-4a43b7163105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9647712-096b-43c2-90a0-4a43b7163105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1916956707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e797f0b-5f6f-47cb-b392-3226a7ec4bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55626cacbcd74e3f8d1b8cf6b5c4ab6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:42Z,use_quota=True,user_id='b0e4114c8def4e8da7c395509f715330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3010e94f-6ca4-4c25-88fc-3b646d034adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3010e94f-6ca4-4c25-88fc-3b646d034adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4210a936-5d85-495c-a122-0fc7f9b5fdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4210a936-5d85-495c-a122-0fc7f9b5fdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e797f0b-5f6f-47cb-b392-3226a7ec4bc8', 'volume_name': 'volume-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac252037-2bc9-4a61-ac40-9e194e33ed6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac252037-2bc9-4a61-ac40-9e194e33ed6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caff90a4-8375-4c9f-be08-2223d3235953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Volume 3e797f0b-5f6f-47cb-b392-3226a7ec4bc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8', 'volume_size': 1} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:41 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Flow 'volume_create_manager' (c57f3736-5073-4f96-b2e6-b65844d9f716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8de4ba2-d1ab-496c-b1f1-55b5f004111d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f4eee1f6-8e07-458d-879c-c8618d45c1dd" returned: 0 in 0.338s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8de4ba2-d1ab-496c-b1f1-55b5f004111d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d4f1b4-2f46-449b-b47b-c426d764c556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a75a6304ded04a6b84601846fbb7d507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:42Z,use_quota=True,user_id='ae24cad9e8174377a85f6a1cf8284174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2500c0b-59aa-4183-9b12-8af9caf86b89),volume_type_id=f2500c0b-59aa-4183-9b12-8af9caf86b89)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec5f7c2-6b5f-442e-9ee0-d523a3c8559c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec5f7c2-6b5f-442e-9ee0-d523a3c8559c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4b9d3d-fb82-447e-9c6b-f5de5690c9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.image.glance [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Creating Keystone auth plugin from conf {{(pid=87084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.257s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-264368824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c1b564-d7b9-45ec-afe9-b72e2809185d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7bdd2e85c584998acc1d8d1bbf4453b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:38Z,use_quota=True,user_id='08ccbea1d7764508b0dd0f42d0cb1240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Creating volume d5c1b564-d7b9-45ec-afe9-b72e2809185d {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:41 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d5c1b564-d7b9-45ec-afe9-b72e2809185d 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299db5ae-d21a-4a17-901d-0c2809a04842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4eee1f6-8e07-458d-879c-c8618d45c1dd', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c629a80b-b91f-4004-8c2e-f2c6b51b53db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:41 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d5c1b564-d7b9-45ec-afe9-b72e2809185d 1073741824 Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:41 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Flow 'volume_create_manager' (b62f72fc-2918-4771-b9aa-d6c1c6b82143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42055016-5fd3-4f3e-aad1-e25c9f854c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Volume volume-f4eee1f6-8e07-458d-879c-c8618d45c1dd (f4eee1f6-8e07-458d-879c-c8618d45c1dd): created successfully Nov 02 10:58:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c629a80b-b91f-4004-8c2e-f2c6b51b53db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Flow 'volume_create_manager' (d1f8d71b-7637-4093-a5cb-4e2d35a94c07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42055016-5fd3-4f3e-aad1-e25c9f854c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-368095535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55626cacbcd74e3f8d1b8cf6b5c4ab6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:42Z,use_quota=True,user_id='b0e4114c8def4e8da7c395509f715330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e84961c-9245-46d1-832a-48fdba284905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e84961c-9245-46d1-832a-48fdba284905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfed7f82-89b7-4b58-9d97-6598767aa292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfed7f82-89b7-4b58-9d97-6598767aa292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50', 'volume_name': 'volume-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fc87d9-fec5-49ac-8115-63980e601f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fc87d9-fec5-49ac-8115-63980e601f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07731d85-56f5-4daf-b807-e52039bad33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Volume 0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50', 'volume_size': 1} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:42 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ede4b0db-a236-44f2-b1db-a4dbfc7f5cdf tempest-CreateVolumesFromImageTest-1035926659 None] Created volume successfully. Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4b9d3d-fb82-447e-9c6b-f5de5690c9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '70d4f1b4-2f46-449b-b47b-c426d764c556', 'volume_name': 'volume-70d4f1b4-2f46-449b-b47b-c426d764c556', 'volume_size': 1, 'image_id': '91ee1360-39f6-4666-81ae-553f81413096', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/91ee1360-39f6-4666-81ae-553f81413096', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f0e59fefd62b242480e306585b045856', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a75a6304ded04a6b84601846fbb7d507', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6bc85ce73db02a1780b41702ff79857f4e554ce0fc7e23c15ca1f0cd5a921b444ef29f897062f3c0e1b9bfef92796270acd6cf44fd031b346bacbbd5d7547dc', 'id': '91ee1360-39f6-4666-81ae-553f81413096', 'created_at': datetime.datetime(2026, 11, 2, 9, 58, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 58, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/91ee1360-39f6-4666-81ae-553f81413096/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe1bfbc-cac7-4712-ae2e-8c1e91e3c00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe1bfbc-cac7-4712-ae2e-8c1e91e3c00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b4beb5-0b8a-44e1-9549-eb5f5c88cdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Volume 70d4f1b4-2f46-449b-b47b-c426d764c556: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-70d4f1b4-2f46-449b-b47b-c426d764c556', 'volume_size': 1, 'image_id': '91ee1360-39f6-4666-81ae-553f81413096', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/91ee1360-39f6-4666-81ae-553f81413096', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f0e59fefd62b242480e306585b045856', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a75a6304ded04a6b84601846fbb7d507', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6bc85ce73db02a1780b41702ff79857f4e554ce0fc7e23c15ca1f0cd5a921b444ef29f897062f3c0e1b9bfef92796270acd6cf44fd031b346bacbbd5d7547dc', 'id': '91ee1360-39f6-4666-81ae-553f81413096', 'created_at': datetime.datetime(2026, 11, 2, 9, 58, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 58, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/91ee1360-39f6-4666-81ae-553f81413096/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Trying to clone 70d4f1b4-2f46-449b-b47b-c426d764c556 from image 91ee1360-39f6-4666-81ae-553f81413096 at location (None, [{'url': 'file:///opt/stack/data/glance/images/91ee1360-39f6-4666-81ae-553f81413096', 'metadata': {}}]). {{(pid=87084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Flow 'volume_create_manager' (a54f1bb1-96d4-476b-8899-144995462bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fffc6e61-d3d4-49d0-a2c8-a82895dc8b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fffc6e61-d3d4-49d0-a2c8-a82895dc8b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1014755372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7bbc1ae-a37e-409b-9b69-ac2be2759ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55626cacbcd74e3f8d1b8cf6b5c4ab6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:42Z,use_quota=True,user_id='b0e4114c8def4e8da7c395509f715330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d003ce5-df5e-4ae1-8c02-10db7e5918e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d003ce5-df5e-4ae1-8c02-10db7e5918e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9678c790-aaac-4e0f-af05-c31447f69464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9678c790-aaac-4e0f-af05-c31447f69464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7bbc1ae-a37e-409b-9b69-ac2be2759ea3', 'volume_name': 'volume-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e29bf8-4998-40fc-9858-20b8d82cc30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e29bf8-4998-40fc-9858-20b8d82cc30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b160a4f-3abd-4425-b63e-f6360f6e3469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Volume d7bbc1ae-a37e-409b-9b69-ac2be2759ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3', 'volume_size': 1} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:58:42 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Image download 0.00 MB at 0.00 MB/s Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[990ccdd3-7808-46a3-b182-aef44a92880b]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:42 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d5c1b564-d7b9-45ec-afe9-b72e2809185d 1073741824" returned: 0 in 0.728s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:42 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD Nov 02 10:58:42 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d5c1b564-d7b9-45ec-afe9-b72e2809185d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:42 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d5c1b564-d7b9-45ec-afe9-b72e2809185d Nov 02 10:58:42 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Flow 'volume_create_manager' (761cfb1b-52af-44cc-af47-0ddbb71f3bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b017568-5917-4b21-848d-359421bc14b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b017568-5917-4b21-848d-359421bc14b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-95666502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26b1f28-a615-4705-b4ab-2b0dc1a82689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55626cacbcd74e3f8d1b8cf6b5c4ab6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:43Z,use_quota=True,user_id='b0e4114c8def4e8da7c395509f715330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a323f8fe-d09a-4c15-b20d-9e5fcf66b612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a323f8fe-d09a-4c15-b20d-9e5fcf66b612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf595ba0-cc3a-489c-8b4f-14e27476fc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf595ba0-cc3a-489c-8b4f-14e27476fc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a26b1f28-a615-4705-b4ab-2b0dc1a82689', 'volume_name': 'volume-a26b1f28-a615-4705-b4ab-2b0dc1a82689', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a770850a-e746-4f82-b8d9-39d012478cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a770850a-e746-4f82-b8d9-39d012478cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35170ba9-9e15-4a55-8370-6c9f47d24d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Volume a26b1f28-a615-4705-b4ab-2b0dc1a82689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a26b1f28-a615-4705-b4ab-2b0dc1a82689', 'volume_size': 1} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:42 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:42 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d5c1b564-d7b9-45ec-afe9-b72e2809185d" returned: 0 in 0.311s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.927s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1229808522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825f96d6-1f26-4726-a6f1-d82bd5de8ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7bdd2e85c584998acc1d8d1bbf4453b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:39Z,use_quota=True,user_id='08ccbea1d7764508b0dd0f42d0cb1240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Creating volume 825f96d6-1f26-4726-a6f1-d82bd5de8ea4 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:43 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-825f96d6-1f26-4726-a6f1-d82bd5de8ea4 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:43 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8f3883-bdb4-47fa-9560-e664d469941b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5c1b564-d7b9-45ec-afe9-b72e2809185d', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:43 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c214344e-04cb-44c1-808e-dfe7fd621ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:43 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-825f96d6-1f26-4726-a6f1-d82bd5de8ea4 1073741824 Nov 02 10:58:43 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:43 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Volume volume-d5c1b564-d7b9-45ec-afe9-b72e2809185d (d5c1b564-d7b9-45ec-afe9-b72e2809185d): created successfully Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c214344e-04cb-44c1-808e-dfe7fd621ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Flow 'volume_create_manager' (1daecd55-e16e-44a2-9a45-488678b9e106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e6c8070a-2825-4619-a44c-5ed0900aa2f1 tempest-CreateVolumesFromImageTest-1035926659 None] Created volume successfully. Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Flow 'volume_create_manager' (48bc314f-51e6-48d6-95af-33b37a8edd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef445318-99de-47f4-90d0-822c40e7b8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef445318-99de-47f4-90d0-822c40e7b8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-344281912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c2e79f-73f5-4c00-8a78-36f67b100464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55626cacbcd74e3f8d1b8cf6b5c4ab6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:43Z,use_quota=True,user_id='b0e4114c8def4e8da7c395509f715330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40b2bfe-2fe2-46cc-b84e-f80f4a3852c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40b2bfe-2fe2-46cc-b84e-f80f4a3852c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ccb4aa3-54a9-42f4-9a98-3d5dc2ad538e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ccb4aa3-54a9-42f4-9a98-3d5dc2ad538e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3c2e79f-73f5-4c00-8a78-36f67b100464', 'volume_name': 'volume-d3c2e79f-73f5-4c00-8a78-36f67b100464', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a18635-bac0-4428-b0d0-3dc4bb48abf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a18635-bac0-4428-b0d0-3dc4bb48abf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35e734a-4fc8-4f1f-ab26-54f99b4dcc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:43 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Volume d3c2e79f-73f5-4c00-8a78-36f67b100464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3c2e79f-73f5-4c00-8a78-36f67b100464', 'volume_size': 1} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:43 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD" returned: 1 in 0.398s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Temporary image 91ee1360-39f6-4666-81ae-553f81413096 is fetched for user ae24cad9e8174377a85f6a1cf8284174. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[db407613-f5af-43e1-bdca-28461c5a14ab]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:43 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD Nov 02 10:58:43 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:43 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-825f96d6-1f26-4726-a6f1-d82bd5de8ea4 1073741824" returned: 0 in 0.499s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-825f96d6-1f26-4726-a6f1-d82bd5de8ea4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:43 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-825f96d6-1f26-4726-a6f1-d82bd5de8ea4 Nov 02 10:58:43 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:43 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:43 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-825f96d6-1f26-4726-a6f1-d82bd5de8ea4" returned: 0 in 0.252s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4a34db79-3c0a-4623-8e7e-7389af8fd9c0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.953s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e405c9d5-7864-42cb-9c29-ffc1b8765d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-825f96d6-1f26-4726-a6f1-d82bd5de8ea4', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f124c78-3117-4a7c-bbeb-e57a7b8bec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4a34db79-3c0a-4623-8e7e-7389af8fd9c0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Creating offline snapshot b1dcccaa-02fc-4e40-a21f-c7adc6c5067e of volume 960c8fff-5ac3-4cf4-bdd8-357899f434ae {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:58:43 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Volume volume-825f96d6-1f26-4726-a6f1-d82bd5de8ea4 (825f96d6-1f26-4726-a6f1-d82bd5de8ea4): created successfully Nov 02 10:58:43 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD Nov 02 10:58:43 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f124c78-3117-4a7c-bbeb-e57a7b8bec15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Flow 'volume_create_manager' (accfefe2-8f7b-4a03-9d9b-e286456e2128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[90220ec1-1781-4254-8ee9-e1df9da89e4e]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a34db79-3c0a-4623-8e7e-7389af8fd9c0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-647b5022-976a-46da-86d4-c6a20e1c961e tempest-CreateVolumesFromImageTest-1035926659 None] Created volume successfully. Nov 02 10:58:43 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae Nov 02 10:58:43 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:44 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD" returned: 1 in 0.326s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:58:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:44 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a34db79-3c0a-4623-8e7e-7389af8fd9c0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae" returned: 0 in 0.364s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a34db79-3c0a-4623-8e7e-7389af8fd9c0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.b1dcccaa-02fc-4e40-a21f-c7adc6c5067e 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:44 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.b1dcccaa-02fc-4e40-a21f-c7adc6c5067e 1G Nov 02 10:58:44 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:44 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a34db79-3c0a-4623-8e7e-7389af8fd9c0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.b1dcccaa-02fc-4e40-a21f-c7adc6c5067e 1G" returned: 0 in 0.390s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a34db79-3c0a-4623-8e7e-7389af8fd9c0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.b1dcccaa-02fc-4e40-a21f-c7adc6c5067e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:44 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.b1dcccaa-02fc-4e40-a21f-c7adc6c5067e Nov 02 10:58:44 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a231e56f-c6f4-42f1-a0f0-89949ddc80b1 tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "cinder-825f96d6-1f26-4726-a6f1-d82bd5de8ea4-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a231e56f-c6f4-42f1-a0f0-89949ddc80b1 tempest-CreateVolumesFromImageTest-1035926659 None] Lock "cinder-825f96d6-1f26-4726-a6f1-d82bd5de8ea4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a231e56f-c6f4-42f1-a0f0-89949ddc80b1 tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "cinder-quobyte-825f96d6-1f26-4726-a6f1-d82bd5de8ea4" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a231e56f-c6f4-42f1-a0f0-89949ddc80b1 tempest-CreateVolumesFromImageTest-1035926659 None] Lock "cinder-quobyte-825f96d6-1f26-4726-a6f1-d82bd5de8ea4" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:44 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8abf004-74e3-4fe7-8f8c-6d47a9b6261a]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a231e56f-c6f4-42f1-a0f0-89949ddc80b1 tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-825f96d6-1f26-4726-a6f1-d82bd5de8ea4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:44 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a34db79-3c0a-4623-8e7e-7389af8fd9c0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.b1dcccaa-02fc-4e40-a21f-c7adc6c5067e" returned: 0 in 0.318s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:44 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-4a34db79-3c0a-4623-8e7e-7389af8fd9c0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.b1dcccaa-02fc-4e40-a21f-c7adc6c5067e is being set with open permissions: ugo+rw Nov 02 10:58:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a34db79-3c0a-4623-8e7e-7389af8fd9c0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.b1dcccaa-02fc-4e40-a21f-c7adc6c5067e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:44 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.b1dcccaa-02fc-4e40-a21f-c7adc6c5067e Nov 02 10:58:44 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:45 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-825f96d6-1f26-4726-a6f1-d82bd5de8ea4 Nov 02 10:58:45 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:45 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a34db79-3c0a-4623-8e7e-7389af8fd9c0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.b1dcccaa-02fc-4e40-a21f-c7adc6c5067e" returned: 0 in 0.271s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a34db79-3c0a-4623-8e7e-7389af8fd9c0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:45 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a231e56f-c6f4-42f1-a0f0-89949ddc80b1 tempest-CreateVolumesFromImageTest-1035926659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-825f96d6-1f26-4726-a6f1-d82bd5de8ea4" returned: 0 in 0.374s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a231e56f-c6f4-42f1-a0f0-89949ddc80b1 tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-825f96d6-1f26-4726-a6f1-d82bd5de8ea4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:45 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.info Nov 02 10:58:45 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:45 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-825f96d6-1f26-4726-a6f1-d82bd5de8ea4 Nov 02 10:58:45 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:45 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a34db79-3c0a-4623-8e7e-7389af8fd9c0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.info" returned: 0 in 0.264s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:45 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-4a34db79-3c0a-4623-8e7e-7389af8fd9c0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.info is being set with open permissions: ugo+rw Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a34db79-3c0a-4623-8e7e-7389af8fd9c0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:45 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a231e56f-c6f4-42f1-a0f0-89949ddc80b1 tempest-CreateVolumesFromImageTest-1035926659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-825f96d6-1f26-4726-a6f1-d82bd5de8ea4" returned: 0 in 0.261s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:45 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.info Nov 02 10:58:45 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a231e56f-c6f4-42f1-a0f0-89949ddc80b1 tempest-CreateVolumesFromImageTest-1035926659 None] Lock "cinder-quobyte-825f96d6-1f26-4726-a6f1-d82bd5de8ea4" released by "delete_volume" :: held 0.677s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a231e56f-c6f4-42f1-a0f0-89949ddc80b1 tempest-CreateVolumesFromImageTest-1035926659 None] Created reservations ['c8decf25-fa92-42e9-bcb2-4ffecd44f4e1', '364a953a-ff0b-4605-a2ca-d8dd73b760cc', 'bd6a1204-91ab-499a-95f1-c4595513578c', 'd60fffe8-b39e-4e34-938f-16b300fba64e'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a231e56f-c6f4-42f1-a0f0-89949ddc80b1 tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a231e56f-c6f4-42f1-a0f0-89949ddc80b1 tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a231e56f-c6f4-42f1-a0f0-89949ddc80b1 tempest-CreateVolumesFromImageTest-1035926659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a231e56f-c6f4-42f1-a0f0-89949ddc80b1 tempest-CreateVolumesFromImageTest-1035926659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a231e56f-c6f4-42f1-a0f0-89949ddc80b1 tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a231e56f-c6f4-42f1-a0f0-89949ddc80b1 tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:45 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:58:45 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:45 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a34db79-3c0a-4623-8e7e-7389af8fd9c0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.info" returned: 0 in 0.251s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4a34db79-3c0a-4623-8e7e-7389af8fd9c0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1916956707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e797f0b-5f6f-47cb-b392-3226a7ec4bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55626cacbcd74e3f8d1b8cf6b5c4ab6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:42Z,use_quota=True,user_id='b0e4114c8def4e8da7c395509f715330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Creating volume 3e797f0b-5f6f-47cb-b392-3226a7ec4bc8 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:45 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:45 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8 1073741824 Nov 02 10:58:45 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4a34db79-3c0a-4623-8e7e-7389af8fd9c0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Create snapshot completed successfully Nov 02 10:58:45 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a231e56f-c6f4-42f1-a0f0-89949ddc80b1 tempest-CreateVolumesFromImageTest-1035926659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.258s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-a231e56f-c6f4-42f1-a0f0-89949ddc80b1 tempest-CreateVolumesFromImageTest-1035926659 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a231e56f-c6f4-42f1-a0f0-89949ddc80b1 tempest-CreateVolumesFromImageTest-1035926659 None] Deleted volume successfully. Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-efb6d0e7-2e5f-4205-8af3-3eea9734fe3e tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "cinder-d5c1b564-d7b9-45ec-afe9-b72e2809185d-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a231e56f-c6f4-42f1-a0f0-89949ddc80b1 tempest-CreateVolumesFromImageTest-1035926659 None] Lock "cinder-825f96d6-1f26-4726-a6f1-d82bd5de8ea4-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-efb6d0e7-2e5f-4205-8af3-3eea9734fe3e tempest-CreateVolumesFromImageTest-1035926659 None] Lock "cinder-d5c1b564-d7b9-45ec-afe9-b72e2809185d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-efb6d0e7-2e5f-4205-8af3-3eea9734fe3e tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "cinder-quobyte-d5c1b564-d7b9-45ec-afe9-b72e2809185d" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-efb6d0e7-2e5f-4205-8af3-3eea9734fe3e tempest-CreateVolumesFromImageTest-1035926659 None] Lock "cinder-quobyte-d5c1b564-d7b9-45ec-afe9-b72e2809185d" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[459df035-4fef-409c-8cad-ddbc9526bd0d]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-efb6d0e7-2e5f-4205-8af3-3eea9734fe3e tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d5c1b564-d7b9-45ec-afe9-b72e2809185d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:46 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d5c1b564-d7b9-45ec-afe9-b72e2809185d Nov 02 10:58:46 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:46 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8 1073741824" returned: 0 in 0.481s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:46 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8 Nov 02 10:58:46 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:46 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-efb6d0e7-2e5f-4205-8af3-3eea9734fe3e tempest-CreateVolumesFromImageTest-1035926659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d5c1b564-d7b9-45ec-afe9-b72e2809185d" returned: 0 in 0.395s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-efb6d0e7-2e5f-4205-8af3-3eea9734fe3e tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d5c1b564-d7b9-45ec-afe9-b72e2809185d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:46 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d5c1b564-d7b9-45ec-afe9-b72e2809185d Nov 02 10:58:46 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:46 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8" returned: 0 in 0.265s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.534s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-368095535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55626cacbcd74e3f8d1b8cf6b5c4ab6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:42Z,use_quota=True,user_id='b0e4114c8def4e8da7c395509f715330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Creating volume 0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:46 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:46 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50 1073741824 Nov 02 10:58:46 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caff90a4-8375-4c9f-be08-2223d3235953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a2b9eb-3804-4b8a-96f5-0e78fcdb330c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:46 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Volume volume-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8 (3e797f0b-5f6f-47cb-b392-3226a7ec4bc8): created successfully Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a2b9eb-3804-4b8a-96f5-0e78fcdb330c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Flow 'volume_create_manager' (54352047-ecb1-4049-82b2-68e00d7fffdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:46 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6aab5bfc-0236-4fed-90ba-b1dc7c98ce7d tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Created volume successfully. Nov 02 10:58:46 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-efb6d0e7-2e5f-4205-8af3-3eea9734fe3e tempest-CreateVolumesFromImageTest-1035926659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d5c1b564-d7b9-45ec-afe9-b72e2809185d" returned: 0 in 0.323s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-efb6d0e7-2e5f-4205-8af3-3eea9734fe3e tempest-CreateVolumesFromImageTest-1035926659 None] Lock "cinder-quobyte-d5c1b564-d7b9-45ec-afe9-b72e2809185d" released by "delete_volume" :: held 0.767s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-efb6d0e7-2e5f-4205-8af3-3eea9734fe3e tempest-CreateVolumesFromImageTest-1035926659 None] Created reservations ['2ef765b5-1f9b-4789-8518-b2f01c4be4f9', '0d5b405c-d95c-45ff-8ede-c9f8be5128dd', '0745f231-5fd8-4ad3-8b47-d0c146ea5131', 'e0366efc-ef1d-492e-81e5-825c37db442a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Flow 'volume_create_manager' (e5de24b3-48f2-42ae-a20f-efcef5a64060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4c9245-70c8-42f9-8846-3abaebd755c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-efb6d0e7-2e5f-4205-8af3-3eea9734fe3e tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-efb6d0e7-2e5f-4205-8af3-3eea9734fe3e tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-efb6d0e7-2e5f-4205-8af3-3eea9734fe3e tempest-CreateVolumesFromImageTest-1035926659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-efb6d0e7-2e5f-4205-8af3-3eea9734fe3e tempest-CreateVolumesFromImageTest-1035926659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-efb6d0e7-2e5f-4205-8af3-3eea9734fe3e tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-efb6d0e7-2e5f-4205-8af3-3eea9734fe3e tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:47 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:58:47 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4c9245-70c8-42f9-8846-3abaebd755c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-243001917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b897331-5487-457c-a07d-07c0e4e50780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eee9eeb66bd4142a4b168cc5f0f37c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:47Z,use_quota=True,user_id='c79f5ee12f2f438f80e4f1eb8ed1b9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4feaf223-364a-4a32-8572-9bb1708dba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4feaf223-364a-4a32-8572-9bb1708dba30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d15c17ca-87da-4fb4-a6b9-9768dd6a543d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d15c17ca-87da-4fb4-a6b9-9768dd6a543d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b897331-5487-457c-a07d-07c0e4e50780', 'volume_name': 'volume-4b897331-5487-457c-a07d-07c0e4e50780', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96b0c01-1e89-4d38-9267-d52a0d713f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96b0c01-1e89-4d38-9267-d52a0d713f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1696095e-e365-47fa-94bf-825b68846df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:47 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Volume 4b897331-5487-457c-a07d-07c0e4e50780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b897331-5487-457c-a07d-07c0e4e50780', 'volume_size': 1} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-19a1f25b-fb71-44a8-a807-27e135fe7f94 tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "cinder-f4eee1f6-8e07-458d-879c-c8618d45c1dd-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-19a1f25b-fb71-44a8-a807-27e135fe7f94 tempest-CreateVolumesFromImageTest-1035926659 None] Lock "cinder-f4eee1f6-8e07-458d-879c-c8618d45c1dd-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:47 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50 1073741824" returned: 0 in 0.629s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-19a1f25b-fb71-44a8-a807-27e135fe7f94 tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "cinder-quobyte-f4eee1f6-8e07-458d-879c-c8618d45c1dd" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-19a1f25b-fb71-44a8-a807-27e135fe7f94 tempest-CreateVolumesFromImageTest-1035926659 None] Lock "cinder-quobyte-f4eee1f6-8e07-458d-879c-c8618d45c1dd" acquired by "delete_volume" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:47 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50 Nov 02 10:58:47 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:47 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-efb6d0e7-2e5f-4205-8af3-3eea9734fe3e tempest-CreateVolumesFromImageTest-1035926659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.377s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-efb6d0e7-2e5f-4205-8af3-3eea9734fe3e tempest-CreateVolumesFromImageTest-1035926659 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[37eebdd7-fe57-4504-a064-17a10149caed]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-19a1f25b-fb71-44a8-a807-27e135fe7f94 tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f4eee1f6-8e07-458d-879c-c8618d45c1dd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-efb6d0e7-2e5f-4205-8af3-3eea9734fe3e tempest-CreateVolumesFromImageTest-1035926659 None] Deleted volume successfully. Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-efb6d0e7-2e5f-4205-8af3-3eea9734fe3e tempest-CreateVolumesFromImageTest-1035926659 None] Lock "cinder-d5c1b564-d7b9-45ec-afe9-b72e2809185d-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Flow 'volume_create_manager' (a8ae19ce-4e9e-44eb-aeb9-5d7c63b8d21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afd8e32-a6db-40f3-8d62-da990cc93fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afd8e32-a6db-40f3-8d62-da990cc93fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-497243320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf8fb0e-013b-4062-9ae2-c1e525e746aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eee9eeb66bd4142a4b168cc5f0f37c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:47Z,use_quota=True,user_id='c79f5ee12f2f438f80e4f1eb8ed1b9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b5552d-4851-4246-9b73-cd8725be5171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b5552d-4851-4246-9b73-cd8725be5171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fb7a8a-143d-469b-8460-0961eedfc5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:47 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f4eee1f6-8e07-458d-879c-c8618d45c1dd Nov 02 10:58:47 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fb7a8a-143d-469b-8460-0961eedfc5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adf8fb0e-013b-4062-9ae2-c1e525e746aa', 'volume_name': 'volume-adf8fb0e-013b-4062-9ae2-c1e525e746aa', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59dfa5d8-9e46-45ec-a1fc-21b5d2e1c88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59dfa5d8-9e46-45ec-a1fc-21b5d2e1c88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bed9fe3-365e-40bb-9a52-06a2882a8d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:47 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Volume adf8fb0e-013b-4062-9ae2-c1e525e746aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adf8fb0e-013b-4062-9ae2-c1e525e746aa', 'volume_size': 1} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:47 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50" returned: 0 in 0.370s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.284s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1014755372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7bbc1ae-a37e-409b-9b69-ac2be2759ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55626cacbcd74e3f8d1b8cf6b5c4ab6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:42Z,use_quota=True,user_id='b0e4114c8def4e8da7c395509f715330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Creating volume d7bbc1ae-a37e-409b-9b69-ac2be2759ea3 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:47 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07731d85-56f5-4daf-b807-e52039bad33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c15a65-5a41-4a31-b15d-c3670f4b46db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:47 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3 1073741824 Nov 02 10:58:47 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:47 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Volume volume-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50 (0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50): created successfully Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c15a65-5a41-4a31-b15d-c3670f4b46db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Flow 'volume_create_manager' (b62f72fc-2918-4771-b9aa-d6c1c6b82143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2d4d614e-c2ec-4f15-8b51-57e8a279e731 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Created volume successfully. Nov 02 10:58:47 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-19a1f25b-fb71-44a8-a807-27e135fe7f94 tempest-CreateVolumesFromImageTest-1035926659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f4eee1f6-8e07-458d-879c-c8618d45c1dd" returned: 0 in 0.538s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-19a1f25b-fb71-44a8-a807-27e135fe7f94 tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f4eee1f6-8e07-458d-879c-c8618d45c1dd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:47 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f4eee1f6-8e07-458d-879c-c8618d45c1dd Nov 02 10:58:47 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Flow 'volume_create_manager' (9df9d048-9b47-48cb-8ffd-f1b3977840a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c480a6a-ec47-4eba-82b1-84a974386647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c480a6a-ec47-4eba-82b1-84a974386647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-382452791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0450319d-471c-4199-8416-c3616507b11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eee9eeb66bd4142a4b168cc5f0f37c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:48Z,use_quota=True,user_id='c79f5ee12f2f438f80e4f1eb8ed1b9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4a57e0-071f-44d6-8313-945c8656c88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4a57e0-071f-44d6-8313-945c8656c88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0276dd50-b9de-41cf-899c-8e710a04f946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0276dd50-b9de-41cf-899c-8e710a04f946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0450319d-471c-4199-8416-c3616507b11e', 'volume_name': 'volume-0450319d-471c-4199-8416-c3616507b11e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41c7522-4a7b-4001-bc1f-68b65a5792ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41c7522-4a7b-4001-bc1f-68b65a5792ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456602f0-3a8c-4aa9-9ede-9ae87a0b35a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:48 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Volume 0450319d-471c-4199-8416-c3616507b11e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0450319d-471c-4199-8416-c3616507b11e', 'volume_size': 1} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:48 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-19a1f25b-fb71-44a8-a807-27e135fe7f94 tempest-CreateVolumesFromImageTest-1035926659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f4eee1f6-8e07-458d-879c-c8618d45c1dd" returned: 0 in 0.315s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-19a1f25b-fb71-44a8-a807-27e135fe7f94 tempest-CreateVolumesFromImageTest-1035926659 None] Lock "cinder-quobyte-f4eee1f6-8e07-458d-879c-c8618d45c1dd" released by "delete_volume" :: held 0.971s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:48 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3 1073741824" returned: 0 in 0.628s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Flow 'volume_create_manager' (f9813526-2f97-4ecf-bf80-461b9a29ef2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dced68a7-b377-4771-934f-12858713a16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dced68a7-b377-4771-934f-12858713a16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-557510678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3f4a05-49f5-4711-bb87-bbd94df2e601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eee9eeb66bd4142a4b168cc5f0f37c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:48Z,use_quota=True,user_id='c79f5ee12f2f438f80e4f1eb8ed1b9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08844b3-4699-40f4-9d1f-5d60b60f3860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08844b3-4699-40f4-9d1f-5d60b60f3860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79bb1101-9392-4796-87b0-c2a88cb89c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79bb1101-9392-4796-87b0-c2a88cb89c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e3f4a05-49f5-4711-bb87-bbd94df2e601', 'volume_name': 'volume-9e3f4a05-49f5-4711-bb87-bbd94df2e601', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a9e7b2-bffd-4016-9d9b-8992ddf36224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a9e7b2-bffd-4016-9d9b-8992ddf36224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (016d2e3f-d651-4773-bf67-f3c07d5ecb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:48 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Volume 9e3f4a05-49f5-4711-bb87-bbd94df2e601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e3f4a05-49f5-4711-bb87-bbd94df2e601', 'volume_size': 1} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-19a1f25b-fb71-44a8-a807-27e135fe7f94 tempest-CreateVolumesFromImageTest-1035926659 None] Created reservations ['4ffd7fc0-923d-49b7-bf91-a101e1d0085e', '6be9c609-4f21-428a-9c33-a3f1a844770d', 'ff63378c-5d28-4b45-b34b-da6053eb274f', '94704d38-50e9-4b14-9bfa-b61721c61ada'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:58:48 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3 Nov 02 10:58:48 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-19a1f25b-fb71-44a8-a807-27e135fe7f94 tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-19a1f25b-fb71-44a8-a807-27e135fe7f94 tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-19a1f25b-fb71-44a8-a807-27e135fe7f94 tempest-CreateVolumesFromImageTest-1035926659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-19a1f25b-fb71-44a8-a807-27e135fe7f94 tempest-CreateVolumesFromImageTest-1035926659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-19a1f25b-fb71-44a8-a807-27e135fe7f94 tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-19a1f25b-fb71-44a8-a807-27e135fe7f94 tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:48 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:58:48 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:48 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3" returned: 0 in 0.314s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.940s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-95666502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26b1f28-a615-4705-b4ab-2b0dc1a82689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55626cacbcd74e3f8d1b8cf6b5c4ab6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:43Z,use_quota=True,user_id='b0e4114c8def4e8da7c395509f715330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Creating volume a26b1f28-a615-4705-b4ab-2b0dc1a82689 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:48 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a26b1f28-a615-4705-b4ab-2b0dc1a82689 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:48 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a26b1f28-a615-4705-b4ab-2b0dc1a82689 1073741824 Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Flow 'volume_create_manager' (92fa70d1-f6f8-468e-83b1-f1656df77366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:48 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01cb81d0-ca34-4c45-ae86-bc1d9f300d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b160a4f-3abd-4425-b63e-f6360f6e3469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8ab737-f881-47a8-bc7c-a65d5a561e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01cb81d0-ca34-4c45-ae86-bc1d9f300d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2097921936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2948cca-74dc-403a-9690-9ceae81a8af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eee9eeb66bd4142a4b168cc5f0f37c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:49Z,use_quota=True,user_id='c79f5ee12f2f438f80e4f1eb8ed1b9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9822cde1-d6ad-4c36-846f-db84b1957178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:48 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9822cde1-d6ad-4c36-846f-db84b1957178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47feb35-74fb-4481-be4e-4ec75be3d7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47feb35-74fb-4481-be4e-4ec75be3d7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2948cca-74dc-403a-9690-9ceae81a8af2', 'volume_name': 'volume-a2948cca-74dc-403a-9690-9ceae81a8af2', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9f0388-0da5-44e1-9145-4d0da024d572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9f0388-0da5-44e1-9145-4d0da024d572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61592d4e-a13b-4532-9e93-fb0a4ea68d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:48 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Volume a2948cca-74dc-403a-9690-9ceae81a8af2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2948cca-74dc-403a-9690-9ceae81a8af2', 'volume_size': 1} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-19a1f25b-fb71-44a8-a807-27e135fe7f94 tempest-CreateVolumesFromImageTest-1035926659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.308s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-19a1f25b-fb71-44a8-a807-27e135fe7f94 tempest-CreateVolumesFromImageTest-1035926659 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-19a1f25b-fb71-44a8-a807-27e135fe7f94 tempest-CreateVolumesFromImageTest-1035926659 None] Deleted volume successfully. Nov 02 10:58:48 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Volume volume-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3 (d7bbc1ae-a37e-409b-9b69-ac2be2759ea3): created successfully Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8ab737-f881-47a8-bc7c-a65d5a561e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Flow 'volume_create_manager' (a54f1bb1-96d4-476b-8899-144995462bf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-60efb8c7-bd32-4263-9b80-be16ea432aad tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Created volume successfully. Nov 02 10:58:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-19a1f25b-fb71-44a8-a807-27e135fe7f94 tempest-CreateVolumesFromImageTest-1035926659 None] Lock "cinder-f4eee1f6-8e07-458d-879c-c8618d45c1dd-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:49 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a26b1f28-a615-4705-b4ab-2b0dc1a82689 1073741824" returned: 0 in 0.471s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a26b1f28-a615-4705-b4ab-2b0dc1a82689 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:49 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a26b1f28-a615-4705-b4ab-2b0dc1a82689 Nov 02 10:58:49 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-30582360-1118-4b5a-bfcd-6cf92bf1c03c tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "cinder-0b9f75bb-c10c-4671-94c4-afb8282c670b-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-30582360-1118-4b5a-bfcd-6cf92bf1c03c tempest-CreateVolumesFromImageTest-1035926659 None] Lock "cinder-0b9f75bb-c10c-4671-94c4-afb8282c670b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-30582360-1118-4b5a-bfcd-6cf92bf1c03c tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "cinder-quobyte-0b9f75bb-c10c-4671-94c4-afb8282c670b" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-30582360-1118-4b5a-bfcd-6cf92bf1c03c tempest-CreateVolumesFromImageTest-1035926659 None] Lock "cinder-quobyte-0b9f75bb-c10c-4671-94c4-afb8282c670b" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec6d68d-17d4-4907-b295-22ab711822cb]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30582360-1118-4b5a-bfcd-6cf92bf1c03c tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0b9f75bb-c10c-4671-94c4-afb8282c670b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:49 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a26b1f28-a615-4705-b4ab-2b0dc1a82689" returned: 0 in 0.267s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.276s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-344281912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c2e79f-73f5-4c00-8a78-36f67b100464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55626cacbcd74e3f8d1b8cf6b5c4ab6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:43Z,use_quota=True,user_id='b0e4114c8def4e8da7c395509f715330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Creating volume d3c2e79f-73f5-4c00-8a78-36f67b100464 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:49 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d3c2e79f-73f5-4c00-8a78-36f67b100464 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:49 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d3c2e79f-73f5-4c00-8a78-36f67b100464 1073741824 Nov 02 10:58:49 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35170ba9-9e15-4a55-8370-6c9f47d24d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a26b1f28-a615-4705-b4ab-2b0dc1a82689', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a606fe55-d89a-4cdd-bef3-b08a2b577165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:49 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Volume volume-a26b1f28-a615-4705-b4ab-2b0dc1a82689 (a26b1f28-a615-4705-b4ab-2b0dc1a82689): created successfully Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a606fe55-d89a-4cdd-bef3-b08a2b577165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Flow 'volume_create_manager' (761cfb1b-52af-44cc-af47-0ddbb71f3bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-89638456-51ae-4046-ac94-276c28441ac7 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Created volume successfully. Nov 02 10:58:49 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0b9f75bb-c10c-4671-94c4-afb8282c670b Nov 02 10:58:49 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:49 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30582360-1118-4b5a-bfcd-6cf92bf1c03c tempest-CreateVolumesFromImageTest-1035926659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0b9f75bb-c10c-4671-94c4-afb8282c670b" returned: 0 in 0.433s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30582360-1118-4b5a-bfcd-6cf92bf1c03c tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0b9f75bb-c10c-4671-94c4-afb8282c670b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:49 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0b9f75bb-c10c-4671-94c4-afb8282c670b Nov 02 10:58:49 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:50 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d3c2e79f-73f5-4c00-8a78-36f67b100464 1073741824" returned: 0 in 0.473s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d3c2e79f-73f5-4c00-8a78-36f67b100464 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:50 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d3c2e79f-73f5-4c00-8a78-36f67b100464 Nov 02 10:58:50 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:50 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30582360-1118-4b5a-bfcd-6cf92bf1c03c tempest-CreateVolumesFromImageTest-1035926659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0b9f75bb-c10c-4671-94c4-afb8282c670b" returned: 0 in 0.270s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-30582360-1118-4b5a-bfcd-6cf92bf1c03c tempest-CreateVolumesFromImageTest-1035926659 None] Lock "cinder-quobyte-0b9f75bb-c10c-4671-94c4-afb8282c670b" released by "delete_volume" :: held 0.743s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-30582360-1118-4b5a-bfcd-6cf92bf1c03c tempest-CreateVolumesFromImageTest-1035926659 None] Created reservations ['4921ac87-81ce-4f98-b528-b78fbf66b3e6', '9399cf4e-45cc-482d-8ff7-2c46d20c5416', '7cdee193-dd5d-49f8-b202-1ae154b488d2', 'd0b8b7de-7995-40c8-be77-2c15c9382a45'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:58:50 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d3c2e79f-73f5-4c00-8a78-36f67b100464" returned: 0 in 0.249s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.264s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d4f1b4-2f46-449b-b47b-c426d764c556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a75a6304ded04a6b84601846fbb7d507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:42Z,use_quota=True,user_id='ae24cad9e8174377a85f6a1cf8284174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2500c0b-59aa-4183-9b12-8af9caf86b89),volume_type_id=f2500c0b-59aa-4183-9b12-8af9caf86b89)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Creating volume 70d4f1b4-2f46-449b-b47b-c426d764c556 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:50 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-70d4f1b4-2f46-449b-b47b-c426d764c556 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:50 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-70d4f1b4-2f46-449b-b47b-c426d764c556 1073741824 Nov 02 10:58:50 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35e734a-4fc8-4f1f-ab26-54f99b4dcc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3c2e79f-73f5-4c00-8a78-36f67b100464', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (068949df-cadc-4fb7-9f5b-8f335ad54a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:50 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Volume volume-d3c2e79f-73f5-4c00-8a78-36f67b100464 (d3c2e79f-73f5-4c00-8a78-36f67b100464): created successfully Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (068949df-cadc-4fb7-9f5b-8f335ad54a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Flow 'volume_create_manager' (48bc314f-51e6-48d6-95af-33b37a8edd3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-30582360-1118-4b5a-bfcd-6cf92bf1c03c tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-30582360-1118-4b5a-bfcd-6cf92bf1c03c tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-30582360-1118-4b5a-bfcd-6cf92bf1c03c tempest-CreateVolumesFromImageTest-1035926659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-30582360-1118-4b5a-bfcd-6cf92bf1c03c tempest-CreateVolumesFromImageTest-1035926659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-30582360-1118-4b5a-bfcd-6cf92bf1c03c tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30582360-1118-4b5a-bfcd-6cf92bf1c03c tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:50 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a665c652-cabb-42ae-a939-9739b58b3b69 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Created volume successfully. Nov 02 10:58:50 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:58:50 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b86d01ec-a38b-4cf0-8778-3e1df6c1133e tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "cinder-7596164a-58cd-469a-b947-ba9365d8c4aa-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b86d01ec-a38b-4cf0-8778-3e1df6c1133e tempest-CreateVolumesFromImageTest-1035926659 None] Lock "cinder-7596164a-58cd-469a-b947-ba9365d8c4aa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b86d01ec-a38b-4cf0-8778-3e1df6c1133e tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "cinder-quobyte-7596164a-58cd-469a-b947-ba9365d8c4aa" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b86d01ec-a38b-4cf0-8778-3e1df6c1133e tempest-CreateVolumesFromImageTest-1035926659 None] Lock "cinder-quobyte-7596164a-58cd-469a-b947-ba9365d8c4aa" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec24776-56e8-424a-bc17-b9e23b3ccac7]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b86d01ec-a38b-4cf0-8778-3e1df6c1133e tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7596164a-58cd-469a-b947-ba9365d8c4aa {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:50 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30582360-1118-4b5a-bfcd-6cf92bf1c03c tempest-CreateVolumesFromImageTest-1035926659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.310s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-30582360-1118-4b5a-bfcd-6cf92bf1c03c tempest-CreateVolumesFromImageTest-1035926659 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:50 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-30582360-1118-4b5a-bfcd-6cf92bf1c03c tempest-CreateVolumesFromImageTest-1035926659 None] Deleted volume successfully. Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-30582360-1118-4b5a-bfcd-6cf92bf1c03c tempest-CreateVolumesFromImageTest-1035926659 None] Lock "cinder-0b9f75bb-c10c-4671-94c4-afb8282c670b-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:50 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7596164a-58cd-469a-b947-ba9365d8c4aa Nov 02 10:58:50 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:50 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-70d4f1b4-2f46-449b-b47b-c426d764c556 1073741824" returned: 0 in 0.538s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-70d4f1b4-2f46-449b-b47b-c426d764c556 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:50 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-70d4f1b4-2f46-449b-b47b-c426d764c556 Nov 02 10:58:50 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-68144d69-0b31-4b08-b0af-7e542eb34885 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "cinder-d3c2e79f-73f5-4c00-8a78-36f67b100464-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-68144d69-0b31-4b08-b0af-7e542eb34885 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-d3c2e79f-73f5-4c00-8a78-36f67b100464-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-68144d69-0b31-4b08-b0af-7e542eb34885 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "cinder-quobyte-d3c2e79f-73f5-4c00-8a78-36f67b100464" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-68144d69-0b31-4b08-b0af-7e542eb34885 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-quobyte-d3c2e79f-73f5-4c00-8a78-36f67b100464" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e007b6a-13dd-4fe8-af7c-261ab55f89e2]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-68144d69-0b31-4b08-b0af-7e542eb34885 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d3c2e79f-73f5-4c00-8a78-36f67b100464 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:51 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b86d01ec-a38b-4cf0-8778-3e1df6c1133e tempest-CreateVolumesFromImageTest-1035926659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7596164a-58cd-469a-b947-ba9365d8c4aa" returned: 0 in 0.401s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b86d01ec-a38b-4cf0-8778-3e1df6c1133e tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7596164a-58cd-469a-b947-ba9365d8c4aa {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:51 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7596164a-58cd-469a-b947-ba9365d8c4aa Nov 02 10:58:51 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:51 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d3c2e79f-73f5-4c00-8a78-36f67b100464 Nov 02 10:58:51 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:51 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-70d4f1b4-2f46-449b-b47b-c426d764c556" returned: 0 in 0.296s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.109s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-243001917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b897331-5487-457c-a07d-07c0e4e50780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eee9eeb66bd4142a4b168cc5f0f37c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:47Z,use_quota=True,user_id='c79f5ee12f2f438f80e4f1eb8ed1b9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Creating volume 4b897331-5487-457c-a07d-07c0e4e50780 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:51 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4b897331-5487-457c-a07d-07c0e4e50780 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:51 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4b897331-5487-457c-a07d-07c0e4e50780 1073741824 Nov 02 10:58:51 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Attempting download of 91ee1360-39f6-4666-81ae-553f81413096 ((None, [{'url': 'file:///opt/stack/data/glance/images/91ee1360-39f6-4666-81ae-553f81413096', 'metadata': {}}])) to volume 70d4f1b4-2f46-449b-b47b-c426d764c556. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f61386-c63b-44ca-b116-283db3a6283b]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_91ee1360-39f6-4666-81ae-553f81413096__2ooe5oe {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:51 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b86d01ec-a38b-4cf0-8778-3e1df6c1133e tempest-CreateVolumesFromImageTest-1035926659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-7596164a-58cd-469a-b947-ba9365d8c4aa" returned: 0 in 0.284s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b86d01ec-a38b-4cf0-8778-3e1df6c1133e tempest-CreateVolumesFromImageTest-1035926659 None] Lock "cinder-quobyte-7596164a-58cd-469a-b947-ba9365d8c4aa" released by "delete_volume" :: held 0.739s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:51 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_91ee1360-39f6-4666-81ae-553f81413096__2ooe5oe Nov 02 10:58:51 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-b86d01ec-a38b-4cf0-8778-3e1df6c1133e tempest-CreateVolumesFromImageTest-1035926659 None] Created reservations ['bb291d14-6773-4189-9cac-5334a13c7fdb', 'ccc2c11f-06e0-4bf8-80c4-b4bb930f87d8', 'd81ca075-5363-444c-86b2-c98af7b63cce', '9b1c7c63-c428-4a6c-9b13-0d8c48d6187c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:58:51 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-68144d69-0b31-4b08-b0af-7e542eb34885 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d3c2e79f-73f5-4c00-8a78-36f67b100464" returned: 0 in 0.456s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-68144d69-0b31-4b08-b0af-7e542eb34885 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d3c2e79f-73f5-4c00-8a78-36f67b100464 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:51 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d3c2e79f-73f5-4c00-8a78-36f67b100464 Nov 02 10:58:51 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b86d01ec-a38b-4cf0-8778-3e1df6c1133e tempest-CreateVolumesFromImageTest-1035926659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b86d01ec-a38b-4cf0-8778-3e1df6c1133e tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b86d01ec-a38b-4cf0-8778-3e1df6c1133e tempest-CreateVolumesFromImageTest-1035926659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b86d01ec-a38b-4cf0-8778-3e1df6c1133e tempest-CreateVolumesFromImageTest-1035926659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b86d01ec-a38b-4cf0-8778-3e1df6c1133e tempest-CreateVolumesFromImageTest-1035926659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b86d01ec-a38b-4cf0-8778-3e1df6c1133e tempest-CreateVolumesFromImageTest-1035926659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:51 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:58:51 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:51 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_91ee1360-39f6-4666-81ae-553f81413096__2ooe5oe" returned: 0 in 0.379s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_91ee1360-39f6-4666-81ae-553f81413096__2ooe5oe {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:51 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4b897331-5487-457c-a07d-07c0e4e50780 1073741824" returned: 0 in 0.573s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4b897331-5487-457c-a07d-07c0e4e50780 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:51 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_91ee1360-39f6-4666-81ae-553f81413096__2ooe5oe Nov 02 10:58:51 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:51 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:51 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b86d01ec-a38b-4cf0-8778-3e1df6c1133e tempest-CreateVolumesFromImageTest-1035926659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.315s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b86d01ec-a38b-4cf0-8778-3e1df6c1133e tempest-CreateVolumesFromImageTest-1035926659 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-68144d69-0b31-4b08-b0af-7e542eb34885 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d3c2e79f-73f5-4c00-8a78-36f67b100464" returned: 0 in 0.394s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:51 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4b897331-5487-457c-a07d-07c0e4e50780 Nov 02 10:58:51 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:51 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b86d01ec-a38b-4cf0-8778-3e1df6c1133e tempest-CreateVolumesFromImageTest-1035926659 None] Deleted volume successfully. Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-68144d69-0b31-4b08-b0af-7e542eb34885 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-quobyte-d3c2e79f-73f5-4c00-8a78-36f67b100464" released by "delete_volume" :: held 0.911s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b86d01ec-a38b-4cf0-8778-3e1df6c1133e tempest-CreateVolumesFromImageTest-1035926659 None] Lock "cinder-7596164a-58cd-469a-b947-ba9365d8c4aa-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-68144d69-0b31-4b08-b0af-7e542eb34885 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Created reservations ['968b3c0b-8283-4541-8c49-e3116b32a9e1', '0eefe4b5-5c03-4c94-ba7f-7e601a8a6cac', '12d98c57-9fd5-4d29-9265-ee30188a2101', '498f5ba5-4794-4c37-b34c-d00ffdcd5aef'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-68144d69-0b31-4b08-b0af-7e542eb34885 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-68144d69-0b31-4b08-b0af-7e542eb34885 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-68144d69-0b31-4b08-b0af-7e542eb34885 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:52 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-68144d69-0b31-4b08-b0af-7e542eb34885 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-68144d69-0b31-4b08-b0af-7e542eb34885 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-68144d69-0b31-4b08-b0af-7e542eb34885 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_91ee1360-39f6-4666-81ae-553f81413096__2ooe5oe" returned: 1 in 0.441s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_91ee1360-39f6-4666-81ae-553f81413096__2ooe5oe' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4324eb5f-2bdc-4b1e-b13e-6bd468c59849]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:52 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:58:52 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:52 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4b897331-5487-457c-a07d-07c0e4e50780" returned: 0 in 0.379s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.693s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-497243320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf8fb0e-013b-4062-9ae2-c1e525e746aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eee9eeb66bd4142a4b168cc5f0f37c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:47Z,use_quota=True,user_id='c79f5ee12f2f438f80e4f1eb8ed1b9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Creating volume adf8fb0e-013b-4062-9ae2-c1e525e746aa {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:52 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adf8fb0e-013b-4062-9ae2-c1e525e746aa 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:52 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD Nov 02 10:58:52 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1696095e-e365-47fa-94bf-825b68846df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b897331-5487-457c-a07d-07c0e4e50780', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:52 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adf8fb0e-013b-4062-9ae2-c1e525e746aa 1073741824 Nov 02 10:58:52 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e5f780-a6dc-4111-9dbd-ea2eadc87a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:52 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Volume volume-4b897331-5487-457c-a07d-07c0e4e50780 (4b897331-5487-457c-a07d-07c0e4e50780): created successfully Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e5f780-a6dc-4111-9dbd-ea2eadc87a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Flow 'volume_create_manager' (e5de24b3-48f2-42ae-a20f-efcef5a64060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:52 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-293e3f1c-2373-45f1-aba7-c69bb93f82f0 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Created volume successfully. Nov 02 10:58:52 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-68144d69-0b31-4b08-b0af-7e542eb34885 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.328s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-68144d69-0b31-4b08-b0af-7e542eb34885 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:52 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-68144d69-0b31-4b08-b0af-7e542eb34885 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Deleted volume successfully. Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-68144d69-0b31-4b08-b0af-7e542eb34885 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-d3c2e79f-73f5-4c00-8a78-36f67b100464-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:52 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD" returned: 0 in 0.419s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:52 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD Nov 02 10:58:52 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:52 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adf8fb0e-013b-4062-9ae2-c1e525e746aa 1073741824" returned: 0 in 0.597s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adf8fb0e-013b-4062-9ae2-c1e525e746aa {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:52 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adf8fb0e-013b-4062-9ae2-c1e525e746aa Nov 02 10:58:52 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:53 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD" returned: 1 in 0.456s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] 91ee1360-39f6-4666-81ae-553f81413096 was raw, converting to qcow2 {{(pid=87084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-70d4f1b4-2f46-449b-b47b-c426d764c556 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:58:53 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-70d4f1b4-2f46-449b-b47b-c426d764c556 Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:53 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:53 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:58:53 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fe5eda39-13c1-41f5-bb12-5d95cc791078 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "cinder-a26b1f28-a615-4705-b4ab-2b0dc1a82689-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:53 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adf8fb0e-013b-4062-9ae2-c1e525e746aa" returned: 0 in 0.322s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.215s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-382452791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0450319d-471c-4199-8416-c3616507b11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eee9eeb66bd4142a4b168cc5f0f37c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:48Z,use_quota=True,user_id='c79f5ee12f2f438f80e4f1eb8ed1b9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Creating volume 0450319d-471c-4199-8416-c3616507b11e {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:53 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0450319d-471c-4199-8416-c3616507b11e 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:53 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0450319d-471c-4199-8416-c3616507b11e 1073741824 Nov 02 10:58:53 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bed9fe3-365e-40bb-9a52-06a2882a8d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adf8fb0e-013b-4062-9ae2-c1e525e746aa', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1aa637-4a11-4365-bc38-947482ecd26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fe5eda39-13c1-41f5-bb12-5d95cc791078 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-a26b1f28-a615-4705-b4ab-2b0dc1a82689-delete_volume" acquired by "delete_volume" :: waited 0.155s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:53 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Volume volume-adf8fb0e-013b-4062-9ae2-c1e525e746aa (adf8fb0e-013b-4062-9ae2-c1e525e746aa): created successfully Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1aa637-4a11-4365-bc38-947482ecd26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:53 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Flow 'volume_create_manager' (a8ae19ce-4e9e-44eb-aeb9-5d7c63b8d21d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.358s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:58:53 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-269e4e5d-29a4-49f5-a97e-866909d50972 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Created volume successfully. Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fe5eda39-13c1-41f5-bb12-5d95cc791078 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "cinder-quobyte-a26b1f28-a615-4705-b4ab-2b0dc1a82689" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fe5eda39-13c1-41f5-bb12-5d95cc791078 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-quobyte-a26b1f28-a615-4705-b4ab-2b0dc1a82689" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b31293-7848-4d8e-a460-17d891fff276]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fe5eda39-13c1-41f5-bb12-5d95cc791078 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a26b1f28-a615-4705-b4ab-2b0dc1a82689 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:53 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-70d4f1b4-2f46-449b-b47b-c426d764c556" returned: 0 in 0.703s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_91ee1360-39f6-4666-81ae-553f81413096_3upj6210devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-70d4f1b4-2f46-449b-b47b-c426d764c556 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:58:53 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 10:58:53 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a26b1f28-a615-4705-b4ab-2b0dc1a82689 Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-70d4f1b4-2f46-449b-b47b-c426d764c556 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:53 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:53 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-70d4f1b4-2f46-449b-b47b-c426d764c556 1G Nov 02 10:58:53 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:53 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0450319d-471c-4199-8416-c3616507b11e 1073741824" returned: 0 in 0.621s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0450319d-471c-4199-8416-c3616507b11e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:54 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0450319d-471c-4199-8416-c3616507b11e Nov 02 10:58:54 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:54 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fe5eda39-13c1-41f5-bb12-5d95cc791078 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a26b1f28-a615-4705-b4ab-2b0dc1a82689" returned: 0 in 0.563s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fe5eda39-13c1-41f5-bb12-5d95cc791078 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a26b1f28-a615-4705-b4ab-2b0dc1a82689 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:54 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-70d4f1b4-2f46-449b-b47b-c426d764c556 1G" returned: 0 in 0.396s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Downloaded image 91ee1360-39f6-4666-81ae-553f81413096 ((None, [{'url': 'file:///opt/stack/data/glance/images/91ee1360-39f6-4666-81ae-553f81413096', 'metadata': {}}])) to volume 70d4f1b4-2f46-449b-b47b-c426d764c556 successfully. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Temporary image 91ee1360-39f6-4666-81ae-553f81413096 for user ae24cad9e8174377a85f6a1cf8284174 is deleted. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Marking volume 70d4f1b4-2f46-449b-b47b-c426d764c556 as bootable. {{(pid=87084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:58:54 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a26b1f28-a615-4705-b4ab-2b0dc1a82689 Nov 02 10:58:54 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Copying metadata from image 91ee1360-39f6-4666-81ae-553f81413096 to 70d4f1b4-2f46-449b-b47b-c426d764c556. {{(pid=87084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Creating volume glance metadata for volume 70d4f1b4-2f46-449b-b47b-c426d764c556 backed by image 91ee1360-39f6-4666-81ae-553f81413096 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '91ee1360-39f6-4666-81ae-553f81413096', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f0e59fefd62b242480e306585b045856', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b4beb5-0b8a-44e1-9549-eb5f5c88cdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70d4f1b4-2f46-449b-b47b-c426d764c556', 'volume_size': 1, 'image_id': '91ee1360-39f6-4666-81ae-553f81413096', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/91ee1360-39f6-4666-81ae-553f81413096', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f0e59fefd62b242480e306585b045856', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a75a6304ded04a6b84601846fbb7d507', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6bc85ce73db02a1780b41702ff79857f4e554ce0fc7e23c15ca1f0cd5a921b444ef29f897062f3c0e1b9bfef92796270acd6cf44fd031b346bacbbd5d7547dc', 'id': '91ee1360-39f6-4666-81ae-553f81413096', 'created_at': datetime.datetime(2026, 11, 2, 9, 58, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 58, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/91ee1360-39f6-4666-81ae-553f81413096/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c03452-0f61-47fb-b850-112d116dc4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:54 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Volume volume-70d4f1b4-2f46-449b-b47b-c426d764c556 (70d4f1b4-2f46-449b-b47b-c426d764c556): created successfully Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c03452-0f61-47fb-b850-112d116dc4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Flow 'volume_create_manager' (c57f3736-5073-4f96-b2e6-b65844d9f716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1109c86a-fa85-485e-9b23-abdbc6efec33 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Created volume successfully. Nov 02 10:58:54 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0450319d-471c-4199-8416-c3616507b11e" returned: 0 in 0.363s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.914s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-557510678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3f4a05-49f5-4711-bb87-bbd94df2e601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eee9eeb66bd4142a4b168cc5f0f37c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:48Z,use_quota=True,user_id='c79f5ee12f2f438f80e4f1eb8ed1b9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Creating volume 9e3f4a05-49f5-4711-bb87-bbd94df2e601 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:54 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9e3f4a05-49f5-4711-bb87-bbd94df2e601 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456602f0-3a8c-4aa9-9ede-9ae87a0b35a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0450319d-471c-4199-8416-c3616507b11e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef270dbc-b4ec-4ab8-8250-e4973a8cfd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:54 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Volume volume-0450319d-471c-4199-8416-c3616507b11e (0450319d-471c-4199-8416-c3616507b11e): created successfully Nov 02 10:58:54 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9e3f4a05-49f5-4711-bb87-bbd94df2e601 1073741824 Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef270dbc-b4ec-4ab8-8250-e4973a8cfd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:54 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Flow 'volume_create_manager' (9df9d048-9b47-48cb-8ffd-f1b3977840a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2e48c2a2-f13b-4cc9-af40-175a4baeb575 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Created volume successfully. Nov 02 10:58:54 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fe5eda39-13c1-41f5-bb12-5d95cc791078 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a26b1f28-a615-4705-b4ab-2b0dc1a82689" returned: 0 in 0.338s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fe5eda39-13c1-41f5-bb12-5d95cc791078 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-quobyte-a26b1f28-a615-4705-b4ab-2b0dc1a82689" released by "delete_volume" :: held 0.955s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-fe5eda39-13c1-41f5-bb12-5d95cc791078 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Created reservations ['9384ef54-b56e-4c5c-b3aa-bb89f213fbd6', '1462c8c4-4aa8-446c-a854-69fb13b00d19', 'a244f194-d4a0-4546-a25e-3aed1d1ded1e', '2d3452ae-28a1-4c6f-9d77-3364d2fa5bc8'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ac8df0e1-461b-4817-8557-7e4afe754f64 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Acquiring lock "cinder-70d4f1b4-2f46-449b-b47b-c426d764c556-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ac8df0e1-461b-4817-8557-7e4afe754f64 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Lock "cinder-70d4f1b4-2f46-449b-b47b-c426d764c556-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ac8df0e1-461b-4817-8557-7e4afe754f64 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Acquiring lock "cinder-quobyte-70d4f1b4-2f46-449b-b47b-c426d764c556" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ac8df0e1-461b-4817-8557-7e4afe754f64 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Lock "cinder-quobyte-70d4f1b4-2f46-449b-b47b-c426d764c556" acquired by "delete_volume" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fe5eda39-13c1-41f5-bb12-5d95cc791078 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fe5eda39-13c1-41f5-bb12-5d95cc791078 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fe5eda39-13c1-41f5-bb12-5d95cc791078 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fe5eda39-13c1-41f5-bb12-5d95cc791078 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fe5eda39-13c1-41f5-bb12-5d95cc791078 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fe5eda39-13c1-41f5-bb12-5d95cc791078 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daaa46a-beca-4644-b789-4c7db7dae6de]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ac8df0e1-461b-4817-8557-7e4afe754f64 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-70d4f1b4-2f46-449b-b47b-c426d764c556 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:54 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:58:54 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:54 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-70d4f1b4-2f46-449b-b47b-c426d764c556 Nov 02 10:58:54 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:54 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fe5eda39-13c1-41f5-bb12-5d95cc791078 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.302s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:54 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-fe5eda39-13c1-41f5-bb12-5d95cc791078 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:55 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-fe5eda39-13c1-41f5-bb12-5d95cc791078 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Deleted volume successfully. Nov 02 10:58:55 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9e3f4a05-49f5-4711-bb87-bbd94df2e601 1073741824" returned: 0 in 0.680s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fe5eda39-13c1-41f5-bb12-5d95cc791078 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-a26b1f28-a615-4705-b4ab-2b0dc1a82689-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9e3f4a05-49f5-4711-bb87-bbd94df2e601 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:55 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9e3f4a05-49f5-4711-bb87-bbd94df2e601 Nov 02 10:58:55 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:55 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ac8df0e1-461b-4817-8557-7e4afe754f64 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-70d4f1b4-2f46-449b-b47b-c426d764c556" returned: 0 in 0.465s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ac8df0e1-461b-4817-8557-7e4afe754f64 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-70d4f1b4-2f46-449b-b47b-c426d764c556 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:55 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-70d4f1b4-2f46-449b-b47b-c426d764c556 Nov 02 10:58:55 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:55 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9e3f4a05-49f5-4711-bb87-bbd94df2e601" returned: 0 in 0.261s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.437s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2097921936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2948cca-74dc-403a-9690-9ceae81a8af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eee9eeb66bd4142a4b168cc5f0f37c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:49Z,use_quota=True,user_id='c79f5ee12f2f438f80e4f1eb8ed1b9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Creating volume a2948cca-74dc-403a-9690-9ceae81a8af2 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:55 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a2948cca-74dc-403a-9690-9ceae81a8af2 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:55 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a2948cca-74dc-403a-9690-9ceae81a8af2 1073741824 Nov 02 10:58:55 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (016d2e3f-d651-4773-bf67-f3c07d5ecb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e3f4a05-49f5-4711-bb87-bbd94df2e601', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a978db14-f821-4842-9a80-f5ec71fa3fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:55 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Volume volume-9e3f4a05-49f5-4711-bb87-bbd94df2e601 (9e3f4a05-49f5-4711-bb87-bbd94df2e601): created successfully Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a978db14-f821-4842-9a80-f5ec71fa3fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Flow 'volume_create_manager' (f9813526-2f97-4ecf-bf80-461b9a29ef2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:55 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c784df77-98ed-4f47-91c2-03bdd7bf19b5 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Created volume successfully. Nov 02 10:58:55 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ac8df0e1-461b-4817-8557-7e4afe754f64 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-70d4f1b4-2f46-449b-b47b-c426d764c556" returned: 0 in 0.296s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ac8df0e1-461b-4817-8557-7e4afe754f64 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Lock "cinder-quobyte-70d4f1b4-2f46-449b-b47b-c426d764c556" released by "delete_volume" :: held 0.828s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-ac8df0e1-461b-4817-8557-7e4afe754f64 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Created reservations ['43339d49-2909-4e6c-98ae-6dde3e9b7a57', 'fbfd92b4-d100-4b72-9c33-deadfa69d56a', '17746ccb-7308-491a-a8ed-d3682a093c2b', 'ad3a6c30-6bdb-4a2f-b12d-35e652d4c68f'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3da94d82-42f0-4ff2-8e94-6f201599141b tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "cinder-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3da94d82-42f0-4ff2-8e94-6f201599141b tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3da94d82-42f0-4ff2-8e94-6f201599141b tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "cinder-quobyte-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ac8df0e1-461b-4817-8557-7e4afe754f64 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ac8df0e1-461b-4817-8557-7e4afe754f64 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ac8df0e1-461b-4817-8557-7e4afe754f64 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ac8df0e1-461b-4817-8557-7e4afe754f64 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ac8df0e1-461b-4817-8557-7e4afe754f64 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ac8df0e1-461b-4817-8557-7e4afe754f64 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3da94d82-42f0-4ff2-8e94-6f201599141b tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-quobyte-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3" acquired by "delete_volume" :: waited 0.045s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:55 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:58:55 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac88f4e6-b2c6-4fe2-81e9-9e749708b2f5]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3da94d82-42f0-4ff2-8e94-6f201599141b tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:55 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3 Nov 02 10:58:55 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:56 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a2948cca-74dc-403a-9690-9ceae81a8af2 1073741824" returned: 0 in 0.672s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:56 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ac8df0e1-461b-4817-8557-7e4afe754f64 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.416s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-ac8df0e1-461b-4817-8557-7e4afe754f64 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a2948cca-74dc-403a-9690-9ceae81a8af2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:56 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ac8df0e1-461b-4817-8557-7e4afe754f64 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Deleted volume successfully. Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ac8df0e1-461b-4817-8557-7e4afe754f64 tempest-VolumeAndVolumeTypeFromImageTest-1537538524 None] Lock "cinder-70d4f1b4-2f46-449b-b47b-c426d764c556-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:56 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a2948cca-74dc-403a-9690-9ceae81a8af2 Nov 02 10:58:56 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:56 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3da94d82-42f0-4ff2-8e94-6f201599141b tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3" returned: 0 in 0.613s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3da94d82-42f0-4ff2-8e94-6f201599141b tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-db8a321c-940b-49f0-bee9-9154198e199e tempest-ProjectAdminTests-236215028 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8580207824707, 'free_capacity_gb': 1773.8580207824707, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87084) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 10:58:56 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3 Nov 02 10:58:56 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:56 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a2948cca-74dc-403a-9690-9ceae81a8af2" returned: 0 in 0.463s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61592d4e-a13b-4532-9e93-fb0a4ea68d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2948cca-74dc-403a-9690-9ceae81a8af2', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ac688b-389f-44d1-b04c-8c812f09c221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:56 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Volume volume-a2948cca-74dc-403a-9690-9ceae81a8af2 (a2948cca-74dc-403a-9690-9ceae81a8af2): created successfully Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ac688b-389f-44d1-b04c-8c812f09c221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Flow 'volume_create_manager' (92fa70d1-f6f8-468e-83b1-f1656df77366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:56 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-df37fedb-b284-4f0f-98a8-7648a19a22f4 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Created volume successfully. Nov 02 10:58:56 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3da94d82-42f0-4ff2-8e94-6f201599141b tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3" returned: 0 in 0.400s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3da94d82-42f0-4ff2-8e94-6f201599141b tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-quobyte-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3" released by "delete_volume" :: held 1.079s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-3da94d82-42f0-4ff2-8e94-6f201599141b tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Created reservations ['7230d3e3-da3d-4a7c-82d6-c015bb926255', '234db48e-22af-40c2-b37d-6408ded37675', '0da8b179-f2da-4f9e-b52f-8f84c42084c7', '51ba74b9-2a70-46b1-b4ad-c4e0534060a6'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3da94d82-42f0-4ff2-8e94-6f201599141b tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3da94d82-42f0-4ff2-8e94-6f201599141b tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3da94d82-42f0-4ff2-8e94-6f201599141b tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3da94d82-42f0-4ff2-8e94-6f201599141b tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3da94d82-42f0-4ff2-8e94-6f201599141b tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3da94d82-42f0-4ff2-8e94-6f201599141b tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:56 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:58:56 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:57 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3da94d82-42f0-4ff2-8e94-6f201599141b tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.251s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:57 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-3da94d82-42f0-4ff2-8e94-6f201599141b tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3da94d82-42f0-4ff2-8e94-6f201599141b tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Deleted volume successfully. Nov 02 10:58:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3da94d82-42f0-4ff2-8e94-6f201599141b tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-d7bbc1ae-a37e-409b-9b69-ac2be2759ea3-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c04cb742-f71d-463e-ad6e-72b9e4db3958 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "cinder-a2948cca-74dc-403a-9690-9ceae81a8af2-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c04cb742-f71d-463e-ad6e-72b9e4db3958 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-a2948cca-74dc-403a-9690-9ceae81a8af2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c04cb742-f71d-463e-ad6e-72b9e4db3958 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "cinder-quobyte-a2948cca-74dc-403a-9690-9ceae81a8af2" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c04cb742-f71d-463e-ad6e-72b9e4db3958 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-quobyte-a2948cca-74dc-403a-9690-9ceae81a8af2" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-04f73f02-867a-4a44-a486-1ae592b83d5c tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "cinder-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:58 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b5075e-5886-4f51-92c9-b0eeea8f32e0]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c04cb742-f71d-463e-ad6e-72b9e4db3958 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a2948cca-74dc-403a-9690-9ceae81a8af2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-04f73f02-867a-4a44-a486-1ae592b83d5c tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-04f73f02-867a-4a44-a486-1ae592b83d5c tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "cinder-quobyte-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-04f73f02-867a-4a44-a486-1ae592b83d5c tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-quobyte-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:58 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ae9fff-0c13-43cc-829a-ad682443a6d8]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:58 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a2948cca-74dc-403a-9690-9ceae81a8af2 Nov 02 10:58:58 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04f73f02-867a-4a44-a486-1ae592b83d5c tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:58 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50 Nov 02 10:58:58 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:58 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c04cb742-f71d-463e-ad6e-72b9e4db3958 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a2948cca-74dc-403a-9690-9ceae81a8af2" returned: 0 in 0.599s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c04cb742-f71d-463e-ad6e-72b9e4db3958 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a2948cca-74dc-403a-9690-9ceae81a8af2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:58 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a2948cca-74dc-403a-9690-9ceae81a8af2 Nov 02 10:58:58 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:58 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04f73f02-867a-4a44-a486-1ae592b83d5c tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50" returned: 0 in 0.508s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04f73f02-867a-4a44-a486-1ae592b83d5c tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:58 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50 Nov 02 10:58:58 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:58 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c04cb742-f71d-463e-ad6e-72b9e4db3958 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a2948cca-74dc-403a-9690-9ceae81a8af2" returned: 0 in 0.289s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c04cb742-f71d-463e-ad6e-72b9e4db3958 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-quobyte-a2948cca-74dc-403a-9690-9ceae81a8af2" released by "delete_volume" :: held 0.967s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c04cb742-f71d-463e-ad6e-72b9e4db3958 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Created reservations ['fcedebe1-60e5-4226-a073-afb86e382fa6', '1a0ba5cb-de2b-4065-8366-4cfcb111da1e', 'cb717e45-e37d-4bc9-9610-8daf063a775b', '475b2223-d98e-4734-978e-081e56d8372c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:58:59 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04f73f02-867a-4a44-a486-1ae592b83d5c tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50" returned: 0 in 0.378s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-04f73f02-867a-4a44-a486-1ae592b83d5c tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-quobyte-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50" released by "delete_volume" :: held 0.958s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c04cb742-f71d-463e-ad6e-72b9e4db3958 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c04cb742-f71d-463e-ad6e-72b9e4db3958 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c04cb742-f71d-463e-ad6e-72b9e4db3958 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c04cb742-f71d-463e-ad6e-72b9e4db3958 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c04cb742-f71d-463e-ad6e-72b9e4db3958 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c04cb742-f71d-463e-ad6e-72b9e4db3958 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-04f73f02-867a-4a44-a486-1ae592b83d5c tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Created reservations ['a1d2e786-8cf5-459d-9865-0dbf1784d970', '4c4b2bf4-4667-4492-93ee-b0eb56b4021d', '59fd397e-3dd3-4123-ba28-7896ef3060e8', 'e1f55af1-c27b-40d3-a703-f25e53fcc7fe'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:58:59 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:58:59 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04f73f02-867a-4a44-a486-1ae592b83d5c tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04f73f02-867a-4a44-a486-1ae592b83d5c tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04f73f02-867a-4a44-a486-1ae592b83d5c tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04f73f02-867a-4a44-a486-1ae592b83d5c tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04f73f02-867a-4a44-a486-1ae592b83d5c tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04f73f02-867a-4a44-a486-1ae592b83d5c tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:59 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:58:59 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:59 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c04cb742-f71d-463e-ad6e-72b9e4db3958 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.302s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c04cb742-f71d-463e-ad6e-72b9e4db3958 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:59 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c04cb742-f71d-463e-ad6e-72b9e4db3958 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Deleted volume successfully. Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c04cb742-f71d-463e-ad6e-72b9e4db3958 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-a2948cca-74dc-403a-9690-9ceae81a8af2-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:59 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04f73f02-867a-4a44-a486-1ae592b83d5c tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.294s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-04f73f02-867a-4a44-a486-1ae592b83d5c tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:59 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-04f73f02-867a-4a44-a486-1ae592b83d5c tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Deleted volume successfully. Nov 02 10:58:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-04f73f02-867a-4a44-a486-1ae592b83d5c tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-0e60fe4b-e722-49cb-8bfb-6b0fdb4ffe50-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b3bdcbbc-2eb3-42b1-8fc8-e9ffe5df1471 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "cinder-9e3f4a05-49f5-4711-bb87-bbd94df2e601-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b3bdcbbc-2eb3-42b1-8fc8-e9ffe5df1471 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-9e3f4a05-49f5-4711-bb87-bbd94df2e601-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b3bdcbbc-2eb3-42b1-8fc8-e9ffe5df1471 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "cinder-quobyte-9e3f4a05-49f5-4711-bb87-bbd94df2e601" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b3bdcbbc-2eb3-42b1-8fc8-e9ffe5df1471 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-quobyte-9e3f4a05-49f5-4711-bb87-bbd94df2e601" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:00 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c22f91-12cf-4c73-97da-d75038b4bf5e]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b3bdcbbc-2eb3-42b1-8fc8-e9ffe5df1471 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9e3f4a05-49f5-4711-bb87-bbd94df2e601 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5f2f5be1-2460-40e4-8d4c-e6b206a81435 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "cinder-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5f2f5be1-2460-40e4-8d4c-e6b206a81435 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5f2f5be1-2460-40e4-8d4c-e6b206a81435 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "cinder-quobyte-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5f2f5be1-2460-40e4-8d4c-e6b206a81435 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-quobyte-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8" acquired by "delete_volume" :: waited 0.013s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:00 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9e3f4a05-49f5-4711-bb87-bbd94df2e601 Nov 02 10:59:00 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:00 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[82834df1-3937-46e7-a565-20a91630ed54]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5f2f5be1-2460-40e4-8d4c-e6b206a81435 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:00 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8 Nov 02 10:59:00 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:00 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b3bdcbbc-2eb3-42b1-8fc8-e9ffe5df1471 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9e3f4a05-49f5-4711-bb87-bbd94df2e601" returned: 0 in 0.481s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b3bdcbbc-2eb3-42b1-8fc8-e9ffe5df1471 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9e3f4a05-49f5-4711-bb87-bbd94df2e601 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:00 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9e3f4a05-49f5-4711-bb87-bbd94df2e601 Nov 02 10:59:00 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:00 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5f2f5be1-2460-40e4-8d4c-e6b206a81435 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8" returned: 0 in 0.428s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5f2f5be1-2460-40e4-8d4c-e6b206a81435 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:00 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8 Nov 02 10:59:00 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:01 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b3bdcbbc-2eb3-42b1-8fc8-e9ffe5df1471 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9e3f4a05-49f5-4711-bb87-bbd94df2e601" returned: 0 in 0.302s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b3bdcbbc-2eb3-42b1-8fc8-e9ffe5df1471 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-quobyte-9e3f4a05-49f5-4711-bb87-bbd94df2e601" released by "delete_volume" :: held 0.842s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-b3bdcbbc-2eb3-42b1-8fc8-e9ffe5df1471 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Created reservations ['74a0e473-d6d3-4f04-b397-5bcfd5e13836', '57eac760-f35b-4df7-9921-93048fea8d26', '47a8b0fe-c2ff-4cf3-be08-309391b8a687', 'b343d621-5c77-482f-95cc-ce7903e6d756'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b3bdcbbc-2eb3-42b1-8fc8-e9ffe5df1471 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b3bdcbbc-2eb3-42b1-8fc8-e9ffe5df1471 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b3bdcbbc-2eb3-42b1-8fc8-e9ffe5df1471 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b3bdcbbc-2eb3-42b1-8fc8-e9ffe5df1471 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b3bdcbbc-2eb3-42b1-8fc8-e9ffe5df1471 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b3bdcbbc-2eb3-42b1-8fc8-e9ffe5df1471 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:01 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5f2f5be1-2460-40e4-8d4c-e6b206a81435 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8" returned: 0 in 0.362s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:01 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:59:01 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5f2f5be1-2460-40e4-8d4c-e6b206a81435 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-quobyte-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8" released by "delete_volume" :: held 0.868s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-5f2f5be1-2460-40e4-8d4c-e6b206a81435 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Created reservations ['2fec57cb-fe9b-4e98-ab6b-c30be922e77e', '5f2180fc-b883-4c57-90b3-8dd8f16dce9e', '0f82f34f-4119-4c22-a77b-d0de43bef9e1', 'de0ee284-e6a4-493f-bff6-5cfeddc183f9'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-48f8dc7f-3646-445c-89ed-1c11991449a3 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "cinder-0450319d-471c-4199-8416-c3616507b11e-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-48f8dc7f-3646-445c-89ed-1c11991449a3 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-0450319d-471c-4199-8416-c3616507b11e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5f2f5be1-2460-40e4-8d4c-e6b206a81435 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5f2f5be1-2460-40e4-8d4c-e6b206a81435 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5f2f5be1-2460-40e4-8d4c-e6b206a81435 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5f2f5be1-2460-40e4-8d4c-e6b206a81435 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5f2f5be1-2460-40e4-8d4c-e6b206a81435 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5f2f5be1-2460-40e4-8d4c-e6b206a81435 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-48f8dc7f-3646-445c-89ed-1c11991449a3 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "cinder-quobyte-0450319d-471c-4199-8416-c3616507b11e" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:01 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:59:01 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-48f8dc7f-3646-445c-89ed-1c11991449a3 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-quobyte-0450319d-471c-4199-8416-c3616507b11e" acquired by "delete_volume" :: waited 0.034s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-163562e5-30c7-4e68-850c-feb8b778427a tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "cinder-143b3001-a254-4677-806b-25ff03ca074a-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e20aa2-3bf4-4d7a-8812-649024b8fa69]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-48f8dc7f-3646-445c-89ed-1c11991449a3 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0450319d-471c-4199-8416-c3616507b11e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:01 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-163562e5-30c7-4e68-850c-feb8b778427a tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-143b3001-a254-4677-806b-25ff03ca074a-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b3bdcbbc-2eb3-42b1-8fc8-e9ffe5df1471 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.511s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b3bdcbbc-2eb3-42b1-8fc8-e9ffe5df1471 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:01 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b3bdcbbc-2eb3-42b1-8fc8-e9ffe5df1471 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Deleted volume successfully. Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-163562e5-30c7-4e68-850c-feb8b778427a tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "cinder-quobyte-143b3001-a254-4677-806b-25ff03ca074a" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b3bdcbbc-2eb3-42b1-8fc8-e9ffe5df1471 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-9e3f4a05-49f5-4711-bb87-bbd94df2e601-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-163562e5-30c7-4e68-850c-feb8b778427a tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-quobyte-143b3001-a254-4677-806b-25ff03ca074a" acquired by "delete_volume" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c185f517-b595-4292-be8c-3ce926b2625b]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-163562e5-30c7-4e68-850c-feb8b778427a tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-143b3001-a254-4677-806b-25ff03ca074a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:01 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5f2f5be1-2460-40e4-8d4c-e6b206a81435 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.371s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-5f2f5be1-2460-40e4-8d4c-e6b206a81435 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:01 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0450319d-471c-4199-8416-c3616507b11e Nov 02 10:59:01 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:01 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5f2f5be1-2460-40e4-8d4c-e6b206a81435 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Deleted volume successfully. Nov 02 10:59:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5f2f5be1-2460-40e4-8d4c-e6b206a81435 tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-3e797f0b-5f6f-47cb-b392-3226a7ec4bc8-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:02 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-143b3001-a254-4677-806b-25ff03ca074a Nov 02 10:59:02 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Flow 'volume_create_manager' (bd4de724-fb97-4696-a07f-d7fd92c1cdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7e95d4-1030-411b-8d1f-427f9629c07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:02 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-48f8dc7f-3646-445c-89ed-1c11991449a3 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0450319d-471c-4199-8416-c3616507b11e" returned: 0 in 0.656s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-48f8dc7f-3646-445c-89ed-1c11991449a3 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0450319d-471c-4199-8416-c3616507b11e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7e95d4-1030-411b-8d1f-427f9629c07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-69886365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c35c142a-591d-4088-853a-6099f98f8e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de43071a1c4348bf85c649c8f77ffcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:02Z,use_quota=True,user_id='eeeb85b0d7c743069682afbcc7ffccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:02 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b86f4c-1d7d-41ce-8179-cb700fbab636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:02 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0450319d-471c-4199-8416-c3616507b11e Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b86f4c-1d7d-41ce-8179-cb700fbab636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:02 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8aab67-e635-41bd-adf6-d5147abe0963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8aab67-e635-41bd-adf6-d5147abe0963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c35c142a-591d-4088-853a-6099f98f8e8f', 'volume_name': 'volume-c35c142a-591d-4088-853a-6099f98f8e8f', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff5b62f-bce4-4d41-892d-de347b6f8ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff5b62f-bce4-4d41-892d-de347b6f8ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d646f499-9e2d-47ce-a743-fb6923210da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:02 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Volume c35c142a-591d-4088-853a-6099f98f8e8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c35c142a-591d-4088-853a-6099f98f8e8f', 'volume_size': 1} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-69886365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c35c142a-591d-4088-853a-6099f98f8e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de43071a1c4348bf85c649c8f77ffcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:02Z,use_quota=True,user_id='eeeb85b0d7c743069682afbcc7ffccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Creating volume c35c142a-591d-4088-853a-6099f98f8e8f {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:59:02 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-163562e5-30c7-4e68-850c-feb8b778427a tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-143b3001-a254-4677-806b-25ff03ca074a" returned: 0 in 0.531s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-163562e5-30c7-4e68-850c-feb8b778427a tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-143b3001-a254-4677-806b-25ff03ca074a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:02 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f 1073741824 Nov 02 10:59:02 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:02 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-143b3001-a254-4677-806b-25ff03ca074a Nov 02 10:59:02 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:02 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-48f8dc7f-3646-445c-89ed-1c11991449a3 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0450319d-471c-4199-8416-c3616507b11e" returned: 0 in 0.337s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-48f8dc7f-3646-445c-89ed-1c11991449a3 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-quobyte-0450319d-471c-4199-8416-c3616507b11e" released by "delete_volume" :: held 1.078s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:02 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-163562e5-30c7-4e68-850c-feb8b778427a tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-143b3001-a254-4677-806b-25ff03ca074a" returned: 0 in 0.323s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-48f8dc7f-3646-445c-89ed-1c11991449a3 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Created reservations ['17b86f5b-9f41-44f4-9b47-45856d3412d6', 'ba962cbb-bc4a-4418-93bd-f6a38e6af3b4', '7db955e9-eec1-4bd1-b895-638aa644e30b', 'f2cf04dc-f687-40d7-938a-9ef0351ccbca'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-163562e5-30c7-4e68-850c-feb8b778427a tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-quobyte-143b3001-a254-4677-806b-25ff03ca074a" released by "delete_volume" :: held 0.931s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-48f8dc7f-3646-445c-89ed-1c11991449a3 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-48f8dc7f-3646-445c-89ed-1c11991449a3 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-48f8dc7f-3646-445c-89ed-1c11991449a3 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-48f8dc7f-3646-445c-89ed-1c11991449a3 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-48f8dc7f-3646-445c-89ed-1c11991449a3 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-48f8dc7f-3646-445c-89ed-1c11991449a3 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:02 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-163562e5-30c7-4e68-850c-feb8b778427a tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Created reservations ['8b0d4f9d-2c8b-48e0-84a2-4288a342f09c', '79589bf4-9a5f-4ad1-9582-51977d7a044a', '2aa45b7b-883e-4113-89f3-861e8636963b', '83342890-971a-42ea-9230-78ca7322fb37'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:02 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:59:02 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-163562e5-30c7-4e68-850c-feb8b778427a tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-163562e5-30c7-4e68-850c-feb8b778427a tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-163562e5-30c7-4e68-850c-feb8b778427a tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-163562e5-30c7-4e68-850c-feb8b778427a tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-163562e5-30c7-4e68-850c-feb8b778427a tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-163562e5-30c7-4e68-850c-feb8b778427a tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:03 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:59:03 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:03 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f 1073741824" returned: 0 in 0.635s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:03 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f Nov 02 10:59:03 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:03 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-48f8dc7f-3646-445c-89ed-1c11991449a3 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.296s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-48f8dc7f-3646-445c-89ed-1c11991449a3 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-48f8dc7f-3646-445c-89ed-1c11991449a3 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Deleted volume successfully. Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-48f8dc7f-3646-445c-89ed-1c11991449a3 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-0450319d-471c-4199-8416-c3616507b11e-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:03 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-163562e5-30c7-4e68-850c-feb8b778427a tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.311s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-163562e5-30c7-4e68-850c-feb8b778427a tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-163562e5-30c7-4e68-850c-feb8b778427a tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Deleted volume successfully. Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-163562e5-30c7-4e68-850c-feb8b778427a tempest-CreateVolumesFromSourceVolumeTest-2123673125 None] Lock "cinder-143b3001-a254-4677-806b-25ff03ca074a-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:03 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f" returned: 0 in 0.293s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d646f499-9e2d-47ce-a743-fb6923210da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c35c142a-591d-4088-853a-6099f98f8e8f', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51899dfe-19a9-4758-8bb1-c4357b7220e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:03 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Volume volume-c35c142a-591d-4088-853a-6099f98f8e8f (c35c142a-591d-4088-853a-6099f98f8e8f): created successfully Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51899dfe-19a9-4758-8bb1-c4357b7220e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Flow 'volume_create_manager' (bd4de724-fb97-4696-a07f-d7fd92c1cdb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7fd1e785-542c-4c0c-bca1-18b2291cc7fc tempest-ProjectMemberTests-1266221133 None] Created volume successfully. Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ef930d04-40ca-4ce2-8bf2-ed0b22ebc4f8 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "cinder-adf8fb0e-013b-4062-9ae2-c1e525e746aa-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ef930d04-40ca-4ce2-8bf2-ed0b22ebc4f8 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-adf8fb0e-013b-4062-9ae2-c1e525e746aa-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ef930d04-40ca-4ce2-8bf2-ed0b22ebc4f8 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "cinder-quobyte-adf8fb0e-013b-4062-9ae2-c1e525e746aa" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ef930d04-40ca-4ce2-8bf2-ed0b22ebc4f8 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-quobyte-adf8fb0e-013b-4062-9ae2-c1e525e746aa" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4977b4be-fb9a-4edf-86ac-8a552c8e05fc]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ef930d04-40ca-4ce2-8bf2-ed0b22ebc4f8 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adf8fb0e-013b-4062-9ae2-c1e525e746aa {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:03 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adf8fb0e-013b-4062-9ae2-c1e525e746aa Nov 02 10:59:03 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:04 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ef930d04-40ca-4ce2-8bf2-ed0b22ebc4f8 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adf8fb0e-013b-4062-9ae2-c1e525e746aa" returned: 0 in 0.410s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ef930d04-40ca-4ce2-8bf2-ed0b22ebc4f8 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adf8fb0e-013b-4062-9ae2-c1e525e746aa {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:04 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adf8fb0e-013b-4062-9ae2-c1e525e746aa Nov 02 10:59:04 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:04 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ef930d04-40ca-4ce2-8bf2-ed0b22ebc4f8 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-adf8fb0e-013b-4062-9ae2-c1e525e746aa" returned: 0 in 0.286s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ef930d04-40ca-4ce2-8bf2-ed0b22ebc4f8 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-quobyte-adf8fb0e-013b-4062-9ae2-c1e525e746aa" released by "delete_volume" :: held 0.758s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:04 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-ef930d04-40ca-4ce2-8bf2-ed0b22ebc4f8 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Created reservations ['117f051b-69c4-4159-9c02-7e59f1c8ee5f', '3443cf1c-4fdd-4b77-a9cf-f235006f906b', 'c72315c7-5a92-4e7d-9ef9-1bd19cd379e1', '83dfd39f-b7ee-4d31-9aca-0966c32e4f53'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ef930d04-40ca-4ce2-8bf2-ed0b22ebc4f8 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ef930d04-40ca-4ce2-8bf2-ed0b22ebc4f8 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ef930d04-40ca-4ce2-8bf2-ed0b22ebc4f8 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ef930d04-40ca-4ce2-8bf2-ed0b22ebc4f8 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ef930d04-40ca-4ce2-8bf2-ed0b22ebc4f8 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ef930d04-40ca-4ce2-8bf2-ed0b22ebc4f8 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:04 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:59:04 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8e6d123b-4916-4b94-af54-3d9c0e867bcc tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8e6d123b-4916-4b94-af54-3d9c0e867bcc tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:05 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ef930d04-40ca-4ce2-8bf2-ed0b22ebc4f8 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.303s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-ef930d04-40ca-4ce2-8bf2-ed0b22ebc4f8 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2cf0a90c-ba31-4f52-b57a-1a9500975948 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "cinder-4b897331-5487-457c-a07d-07c0e4e50780-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:05 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ef930d04-40ca-4ce2-8bf2-ed0b22ebc4f8 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Deleted volume successfully. Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-8e6d123b-4916-4b94-af54-3d9c0e867bcc tempest-ProjectMemberTests-1266221133 None] Creating offline snapshot db9f3888-73dd-4e0c-93ba-476b3be728dd of volume c35c142a-591d-4088-853a-6099f98f8e8f {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2cf0a90c-ba31-4f52-b57a-1a9500975948 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-4b897331-5487-457c-a07d-07c0e4e50780-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb725c20-bd64-472f-9707-45894ca77fba]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ef930d04-40ca-4ce2-8bf2-ed0b22ebc4f8 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-adf8fb0e-013b-4062-9ae2-c1e525e746aa-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8e6d123b-4916-4b94-af54-3d9c0e867bcc tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2cf0a90c-ba31-4f52-b57a-1a9500975948 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "cinder-quobyte-4b897331-5487-457c-a07d-07c0e4e50780" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2cf0a90c-ba31-4f52-b57a-1a9500975948 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-quobyte-4b897331-5487-457c-a07d-07c0e4e50780" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b2c637-4f38-4f96-af8e-7f6916668d76]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2cf0a90c-ba31-4f52-b57a-1a9500975948 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4b897331-5487-457c-a07d-07c0e4e50780 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:05 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f Nov 02 10:59:05 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:05 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4b897331-5487-457c-a07d-07c0e4e50780 Nov 02 10:59:05 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:05 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8e6d123b-4916-4b94-af54-3d9c0e867bcc tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f" returned: 0 in 0.493s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8e6d123b-4916-4b94-af54-3d9c0e867bcc tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.db9f3888-73dd-4e0c-93ba-476b3be728dd 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:05 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.db9f3888-73dd-4e0c-93ba-476b3be728dd 1G Nov 02 10:59:05 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Flow 'volume_create_manager' (ea3d3025-7f6b-42c6-a31f-163a2a345130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553cc932-9804-4ed4-8086-3618564550a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553cc932-9804-4ed4-8086-3618564550a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=142bb7c1-c735-46db-a4f6-5b0c2e9a6cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ef9c01e05242c794ab128d464e98b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:06Z,use_quota=True,user_id='d580751459004195ae2c31f0977f6f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:05 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281ca375-2d6f-448d-9453-6ed931b1c216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281ca375-2d6f-448d-9453-6ed931b1c216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdcc9a94-fe10-4466-bf4b-1a8dfe9d3ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG cinder.image.glance [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Creating Keystone auth plugin from conf {{(pid=87084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2cf0a90c-ba31-4f52-b57a-1a9500975948 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4b897331-5487-457c-a07d-07c0e4e50780" returned: 0 in 0.524s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2cf0a90c-ba31-4f52-b57a-1a9500975948 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4b897331-5487-457c-a07d-07c0e4e50780 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:05 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4b897331-5487-457c-a07d-07c0e4e50780 Nov 02 10:59:05 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:06 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2cf0a90c-ba31-4f52-b57a-1a9500975948 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4b897331-5487-457c-a07d-07c0e4e50780" returned: 0 in 0.337s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2cf0a90c-ba31-4f52-b57a-1a9500975948 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-quobyte-4b897331-5487-457c-a07d-07c0e4e50780" released by "delete_volume" :: held 0.910s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:06 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdcc9a94-fe10-4466-bf4b-1a8dfe9d3ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '142bb7c1-c735-46db-a4f6-5b0c2e9a6cce', 'volume_name': 'volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce', 'volume_size': 1, 'image_id': '18a6fceb-e50d-4438-b8fd-95bdd069da59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/18a6fceb-e50d-4438-b8fd-95bdd069da59', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cfd3889d863fdbda3a6ae8914059d57f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35ef9c01e05242c794ab128d464e98b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '67afec9fd854f57cc30902caf99905576804daf970d3878e469969f6c42e61bbab221b7c331a5d2c7c2f500cd7a642fdbf5b182c9c3481f1b56354edcd1f2136', 'id': '18a6fceb-e50d-4438-b8fd-95bdd069da59', 'created_at': datetime.datetime(2026, 11, 2, 9, 59, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 59, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/18a6fceb-e50d-4438-b8fd-95bdd069da59/file', 'properties': {}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503b6720-67b9-47e6-a0ae-6301bb44e23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503b6720-67b9-47e6-a0ae-6301bb44e23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a25e65-ee93-47e7-b83f-26a95c97a5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:06 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Volume 142bb7c1-c735-46db-a4f6-5b0c2e9a6cce: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce', 'volume_size': 1, 'image_id': '18a6fceb-e50d-4438-b8fd-95bdd069da59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/18a6fceb-e50d-4438-b8fd-95bdd069da59', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cfd3889d863fdbda3a6ae8914059d57f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35ef9c01e05242c794ab128d464e98b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '67afec9fd854f57cc30902caf99905576804daf970d3878e469969f6c42e61bbab221b7c331a5d2c7c2f500cd7a642fdbf5b182c9c3481f1b56354edcd1f2136', 'id': '18a6fceb-e50d-4438-b8fd-95bdd069da59', 'created_at': datetime.datetime(2026, 11, 2, 9, 59, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 59, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/18a6fceb-e50d-4438-b8fd-95bdd069da59/file', 'properties': {}}, 'image_service': } Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Trying to clone 142bb7c1-c735-46db-a4f6-5b0c2e9a6cce from image 18a6fceb-e50d-4438-b8fd-95bdd069da59 at location (None, [{'url': 'file:///opt/stack/data/glance/images/18a6fceb-e50d-4438-b8fd-95bdd069da59', 'metadata': {}}]). {{(pid=87084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8e6d123b-4916-4b94-af54-3d9c0e867bcc tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.db9f3888-73dd-4e0c-93ba-476b3be728dd 1G" returned: 0 in 0.584s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8e6d123b-4916-4b94-af54-3d9c0e867bcc tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c35c142a-591d-4088-853a-6099f98f8e8f -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.db9f3888-73dd-4e0c-93ba-476b3be728dd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-2cf0a90c-ba31-4f52-b57a-1a9500975948 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Created reservations ['5dc4cab2-3820-4092-8644-ff05181eb476', 'a4449271-2c5b-44a4-bc0c-a344328796a4', '1d9a6549-ad94-4488-a0ce-28945d1f08b2', '08ae9741-884a-4433-99f9-235c48c513a4'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:06 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c35c142a-591d-4088-853a-6099f98f8e8f -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.db9f3888-73dd-4e0c-93ba-476b3be728dd Nov 02 10:59:06 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2cf0a90c-ba31-4f52-b57a-1a9500975948 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2cf0a90c-ba31-4f52-b57a-1a9500975948 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2cf0a90c-ba31-4f52-b57a-1a9500975948 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2cf0a90c-ba31-4f52-b57a-1a9500975948 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2cf0a90c-ba31-4f52-b57a-1a9500975948 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2cf0a90c-ba31-4f52-b57a-1a9500975948 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:59:06 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Image download 0.00 MB at 0.00 MB/s Nov 02 10:59:06 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:59:06 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4869bc-a544-4c79-9af7-c327e81cac0d]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:06 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD Nov 02 10:59:06 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:06 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8e6d123b-4916-4b94-af54-3d9c0e867bcc tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c35c142a-591d-4088-853a-6099f98f8e8f -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.db9f3888-73dd-4e0c-93ba-476b3be728dd" returned: 0 in 0.368s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:06 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-8e6d123b-4916-4b94-af54-3d9c0e867bcc tempest-ProjectMemberTests-1266221133 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.db9f3888-73dd-4e0c-93ba-476b3be728dd is being set with open permissions: ugo+rw Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8e6d123b-4916-4b94-af54-3d9c0e867bcc tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.db9f3888-73dd-4e0c-93ba-476b3be728dd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:06 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.db9f3888-73dd-4e0c-93ba-476b3be728dd Nov 02 10:59:06 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:06 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2cf0a90c-ba31-4f52-b57a-1a9500975948 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.323s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-2cf0a90c-ba31-4f52-b57a-1a9500975948 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:06 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2cf0a90c-ba31-4f52-b57a-1a9500975948 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Deleted volume successfully. Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2cf0a90c-ba31-4f52-b57a-1a9500975948 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-4b897331-5487-457c-a07d-07c0e4e50780-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:06 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:06 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8e6d123b-4916-4b94-af54-3d9c0e867bcc tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.db9f3888-73dd-4e0c-93ba-476b3be728dd" returned: 0 in 0.292s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8e6d123b-4916-4b94-af54-3d9c0e867bcc tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:06 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD Nov 02 10:59:06 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:06 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.info Nov 02 10:59:06 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:07 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Temporary image 18a6fceb-e50d-4438-b8fd-95bdd069da59 is fetched for user d580751459004195ae2c31f0977f6f3f. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:59:07 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8e6d123b-4916-4b94-af54-3d9c0e867bcc tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.info" returned: 0 in 0.271s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:07 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-8e6d123b-4916-4b94-af54-3d9c0e867bcc tempest-ProjectMemberTests-1266221133 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.info is being set with open permissions: ugo+rw Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8e6d123b-4916-4b94-af54-3d9c0e867bcc tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:07 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.info Nov 02 10:59:07 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b0f029-2a67-4710-8a87-abe3bc613751]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "cinder-b1dcccaa-02fc-4e40-a21f-c7adc6c5067e-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-b1dcccaa-02fc-4e40-a21f-c7adc6c5067e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "cinder-quobyte-960c8fff-5ac3-4cf4-bdd8-357899f434ae" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-quobyte-960c8fff-5ac3-4cf4-bdd8-357899f434ae" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "cinder-quobyte-b1dcccaa-02fc-4e40-a21f-c7adc6c5067e" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:07 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD Nov 02 10:59:07 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-quobyte-b1dcccaa-02fc-4e40-a21f-c7adc6c5067e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Deleting offline snapshot b1dcccaa-02fc-4e40-a21f-c7adc6c5067e of volume 960c8fff-5ac3-4cf4-bdd8-357899f434ae {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] snapshot_file for this snap is: volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.b1dcccaa-02fc-4e40-a21f-c7adc6c5067e {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee05dce7-50ea-4b46-baae-415ce1d2664d]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.b1dcccaa-02fc-4e40-a21f-c7adc6c5067e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:07 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8e6d123b-4916-4b94-af54-3d9c0e867bcc tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.info" returned: 0 in 0.301s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8e6d123b-4916-4b94-af54-3d9c0e867bcc tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.481s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:07 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8e6d123b-4916-4b94-af54-3d9c0e867bcc tempest-ProjectMemberTests-1266221133 None] Create snapshot completed successfully Nov 02 10:59:07 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.b1dcccaa-02fc-4e40-a21f-c7adc6c5067e Nov 02 10:59:07 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:07 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Flow 'volume_create_manager' (d34b8bd5-dea4-4618-b342-e912ff04bf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e28b968e-0d17-4f2a-9a91-cc179f2c8057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:07 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD Nov 02 10:59:07 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e28b968e-0d17-4f2a-9a91-cc179f2c8057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1010248507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4ddf20-bc06-46a0-8937-d4600699c568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d46ff4301347e198fafd0480f5b6d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:08Z,use_quota=True,user_id='0f5b1f8e05384c568ab92cae706afdd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed619e2-65fa-46bd-9d8a-0c4bd4c700cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed619e2-65fa-46bd-9d8a-0c4bd4c700cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b93bb24-b0fd-4c94-bfb0-02239e0029be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b93bb24-b0fd-4c94-bfb0-02239e0029be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec4ddf20-bc06-46a0-8937-d4600699c568', 'volume_name': 'volume-ec4ddf20-bc06-46a0-8937-d4600699c568', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9b2e9e-6ddf-4cd0-aedb-ed01951bd1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9b2e9e-6ddf-4cd0-aedb-ed01951bd1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c95e1d7d-e313-420a-9440-e936b52d3e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:07 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Volume ec4ddf20-bc06-46a0-8937-d4600699c568: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec4ddf20-bc06-46a0-8937-d4600699c568', 'volume_size': 1} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1010248507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4ddf20-bc06-46a0-8937-d4600699c568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d46ff4301347e198fafd0480f5b6d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:08Z,use_quota=True,user_id='0f5b1f8e05384c568ab92cae706afdd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Creating volume ec4ddf20-bc06-46a0-8937-d4600699c568 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:59:07 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:07 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568 1073741824 Nov 02 10:59:07 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:07 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.b1dcccaa-02fc-4e40-a21f-c7adc6c5067e" returned: 0 in 0.480s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a65d4e-a766-46e8-8968-7db2fd0395e6]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:07 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD" returned: 1 in 0.374s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:59:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:08 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae Nov 02 10:59:08 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-db9f3888-73dd-4e0c-93ba-476b3be728dd-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-db9f3888-73dd-4e0c-93ba-476b3be728dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-c35c142a-591d-4088-853a-6099f98f8e8f" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-c35c142a-591d-4088-853a-6099f98f8e8f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-db9f3888-73dd-4e0c-93ba-476b3be728dd" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-db9f3888-73dd-4e0c-93ba-476b3be728dd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] Deleting offline snapshot db9f3888-73dd-4e0c-93ba-476b3be728dd of volume c35c142a-591d-4088-853a-6099f98f8e8f {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] snapshot_file for this snap is: volume-c35c142a-591d-4088-853a-6099f98f8e8f.db9f3888-73dd-4e0c-93ba-476b3be728dd {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a57946-0c4e-4f58-a3e0-beb80ae38100]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.db9f3888-73dd-4e0c-93ba-476b3be728dd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:08 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568 1073741824" returned: 0 in 0.498s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:08 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.db9f3888-73dd-4e0c-93ba-476b3be728dd Nov 02 10:59:08 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:08 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae" returned: 0 in 0.419s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.b1dcccaa-02fc-4e40-a21f-c7adc6c5067e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:08 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568 Nov 02 10:59:08 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:08 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.b1dcccaa-02fc-4e40-a21f-c7adc6c5067e Nov 02 10:59:08 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:08 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568" returned: 0 in 0.253s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.596s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=142bb7c1-c735-46db-a4f6-5b0c2e9a6cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ef9c01e05242c794ab128d464e98b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:06Z,use_quota=True,user_id='d580751459004195ae2c31f0977f6f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Creating volume 142bb7c1-c735-46db-a4f6-5b0c2e9a6cce {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:59:08 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:08 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.db9f3888-73dd-4e0c-93ba-476b3be728dd" returned: 0 in 0.430s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c35c142a-591d-4088-853a-6099f98f8e8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:59:08 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce 1073741824 Nov 02 10:59:08 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c95e1d7d-e313-420a-9440-e936b52d3e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec4ddf20-bc06-46a0-8937-d4600699c568', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4015d71d-01f7-4ae5-a1c0-291bc53f6f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd403585-c64f-4af5-984d-69c22747f79a]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:08 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Volume volume-ec4ddf20-bc06-46a0-8937-d4600699c568 (ec4ddf20-bc06-46a0-8937-d4600699c568): created successfully Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4015d71d-01f7-4ae5-a1c0-291bc53f6f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Flow 'volume_create_manager' (d34b8bd5-dea4-4618-b342-e912ff04bf72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:08 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-29d771ab-f194-4dcb-8c92-967f995d6d18 tempest-VolumeDependencyTests-1727860628 None] Created volume successfully. Nov 02 10:59:08 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.b1dcccaa-02fc-4e40-a21f-c7adc6c5067e" returned: 0 in 0.458s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.b1dcccaa-02fc-4e40-a21f-c7adc6c5067e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:08 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f Nov 02 10:59:08 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:08 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.b1dcccaa-02fc-4e40-a21f-c7adc6c5067e Nov 02 10:59:08 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:09 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:09 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae.b1dcccaa-02fc-4e40-a21f-c7adc6c5067e" returned: 0 in 0.273s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce 1073741824" returned: 0 in 0.474s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:09 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f" returned: 0 in 0.410s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.db9f3888-73dd-4e0c-93ba-476b3be728dd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:09 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.db9f3888-73dd-4e0c-93ba-476b3be728dd Nov 02 10:59:09 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-quobyte-b1dcccaa-02fc-4e40-a21f-c7adc6c5067e" released by "_delete_snapshot" :: held 1.791s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-quobyte-960c8fff-5ac3-4cf4-bdd8-357899f434ae" released by "delete_snapshot" :: held 1.832s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:09 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce Nov 02 10:59:09 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Created reservations ['2fe7a11e-7da7-4f52-b155-0ea3ef8a7d37', 'aaa22537-733d-4136-a315-24226df10ca0', 'f11cc2d1-7a71-4832-a355-a4c860abb7e5', 'fe60a0eb-938b-4c2e-b4ab-f210c3c216cd'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:09 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Delete snapshot completed successfully. Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a7eb7114-d2bf-4b84-92c4-b3bc84aaff34 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-b1dcccaa-02fc-4e40-a21f-c7adc6c5067e-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:09 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce" returned: 0 in 0.267s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-07931efe-146d-464d-a27f-0eaac230c746 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "cinder-960c8fff-5ac3-4cf4-bdd8-357899f434ae-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Attempting download of 18a6fceb-e50d-4438-b8fd-95bdd069da59 ((None, [{'url': 'file:///opt/stack/data/glance/images/18a6fceb-e50d-4438-b8fd-95bdd069da59', 'metadata': {}}])) to volume 142bb7c1-c735-46db-a4f6-5b0c2e9a6cce. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-07931efe-146d-464d-a27f-0eaac230c746 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-960c8fff-5ac3-4cf4-bdd8-357899f434ae-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:09 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.db9f3888-73dd-4e0c-93ba-476b3be728dd" returned: 0 in 0.400s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.db9f3888-73dd-4e0c-93ba-476b3be728dd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:09 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.db9f3888-73dd-4e0c-93ba-476b3be728dd Nov 02 10:59:09 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b36bcf5-a3b9-4176-a4b5-3e22635606dc]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_18a6fceb-e50d-4438-b8fd-95bdd069da59_2f2vpn3i {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-07931efe-146d-464d-a27f-0eaac230c746 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "cinder-quobyte-960c8fff-5ac3-4cf4-bdd8-357899f434ae" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-07931efe-146d-464d-a27f-0eaac230c746 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-quobyte-960c8fff-5ac3-4cf4-bdd8-357899f434ae" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df6af18-fec7-4d4b-bafa-79a83cbf96f5]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-07931efe-146d-464d-a27f-0eaac230c746 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:09 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_18a6fceb-e50d-4438-b8fd-95bdd069da59_2f2vpn3i Nov 02 10:59:09 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:09 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae Nov 02 10:59:09 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:09 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f.db9f3888-73dd-4e0c-93ba-476b3be728dd" returned: 0 in 0.327s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-db9f3888-73dd-4e0c-93ba-476b3be728dd" released by "_delete_snapshot" :: held 1.723s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-c35c142a-591d-4088-853a-6099f98f8e8f" released by "delete_snapshot" :: held 1.751s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:09 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_18a6fceb-e50d-4438-b8fd-95bdd069da59_2f2vpn3i" returned: 0 in 0.383s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_18a6fceb-e50d-4438-b8fd-95bdd069da59_2f2vpn3i {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] Created reservations ['af4d774b-8801-43ec-9f5b-d165fa1d5b07', '55ce5442-6e5e-4b90-93b9-751f4160fd23', '49a26fc3-288d-4500-9f9d-1e482a8c6da9', 'c6354008-ed4c-432c-8996-95bd2950d868'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-25970569-5f13-4794-8e6f-662db5fdc2c0 tempest-VolumeDependencyTests-1727860628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-25970569-5f13-4794-8e6f-662db5fdc2c0 tempest-VolumeDependencyTests-1727860628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:10 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_18a6fceb-e50d-4438-b8fd-95bdd069da59_2f2vpn3i Nov 02 10:59:10 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:10 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-07931efe-146d-464d-a27f-0eaac230c746 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae" returned: 0 in 0.462s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-07931efe-146d-464d-a27f-0eaac230c746 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-25970569-5f13-4794-8e6f-662db5fdc2c0 tempest-VolumeDependencyTests-1727860628 None] Creating offline snapshot 6d969c93-0b3d-40b1-b26a-9e01d86ccc41 of volume ec4ddf20-bc06-46a0-8937-d4600699c568 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:59:10 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] Delete snapshot completed successfully. Nov 02 10:59:10 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae Nov 02 10:59:10 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-77647e4b-11c0-4143-8564-408d91e6db76 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-db9f3888-73dd-4e0c-93ba-476b3be728dd-delete_snapshot" released by "delete_snapshot" :: held 2.008s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab57bdd-bbfd-4422-b722-07f9af50aabc]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-25970569-5f13-4794-8e6f-662db5fdc2c0 tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:10 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568 Nov 02 10:59:10 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:10 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1ecff899-3b74-4c56-8399-83b9cf3d565d tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-c35c142a-591d-4088-853a-6099f98f8e8f-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_18a6fceb-e50d-4438-b8fd-95bdd069da59_2f2vpn3i" returned: 1 in 0.401s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_18a6fceb-e50d-4438-b8fd-95bdd069da59_2f2vpn3i' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5925bf9-9eb4-4a4c-8b03-6c8fe9c10116]: (4, 'raw') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1ecff899-3b74-4c56-8399-83b9cf3d565d tempest-ProjectMemberTests-1266221133 None] Lock "cinder-c35c142a-591d-4088-853a-6099f98f8e8f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:10 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-07931efe-146d-464d-a27f-0eaac230c746 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-960c8fff-5ac3-4cf4-bdd8-357899f434ae" returned: 0 in 0.310s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1ecff899-3b74-4c56-8399-83b9cf3d565d tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-c35c142a-591d-4088-853a-6099f98f8e8f" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-07931efe-146d-464d-a27f-0eaac230c746 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-quobyte-960c8fff-5ac3-4cf4-bdd8-357899f434ae" released by "delete_volume" :: held 0.861s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1ecff899-3b74-4c56-8399-83b9cf3d565d tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-c35c142a-591d-4088-853a-6099f98f8e8f" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:10 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD Nov 02 10:59:10 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91b52f4-0e7f-4d45-b3ce-dd4a11b8c043]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1ecff899-3b74-4c56-8399-83b9cf3d565d tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-07931efe-146d-464d-a27f-0eaac230c746 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Created reservations ['b2709278-e54c-4b24-a32d-9c7a4de56d65', '67245bc3-1f7b-4d9a-9159-b9be0edc86e3', 'a68fb3bf-ad0a-4340-a8bb-bdc835779bff', '6470ca1a-287a-450e-8c06-5a77af863c3c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:10 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-25970569-5f13-4794-8e6f-662db5fdc2c0 tempest-VolumeDependencyTests-1727860628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568" returned: 0 in 0.428s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-25970569-5f13-4794-8e6f-662db5fdc2c0 tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:10 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41 1G Nov 02 10:59:10 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:10 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f Nov 02 10:59:10 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-07931efe-146d-464d-a27f-0eaac230c746 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-07931efe-146d-464d-a27f-0eaac230c746 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-07931efe-146d-464d-a27f-0eaac230c746 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-07931efe-146d-464d-a27f-0eaac230c746 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-07931efe-146d-464d-a27f-0eaac230c746 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-07931efe-146d-464d-a27f-0eaac230c746 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:10 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:59:10 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:10 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:10 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD Nov 02 10:59:10 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:10 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1ecff899-3b74-4c56-8399-83b9cf3d565d tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f" returned: 0 in 0.481s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1ecff899-3b74-4c56-8399-83b9cf3d565d tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:11 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f Nov 02 10:59:11 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:11 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-07931efe-146d-464d-a27f-0eaac230c746 tempest-CreateVolumesFromSnapshotTest-1406413172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.331s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-07931efe-146d-464d-a27f-0eaac230c746 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:11 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-07931efe-146d-464d-a27f-0eaac230c746 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Deleted volume successfully. Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-07931efe-146d-464d-a27f-0eaac230c746 tempest-CreateVolumesFromSnapshotTest-1406413172 None] Lock "cinder-960c8fff-5ac3-4cf4-bdd8-357899f434ae-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:11 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-25970569-5f13-4794-8e6f-662db5fdc2c0 tempest-VolumeDependencyTests-1727860628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41 1G" returned: 0 in 0.551s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-25970569-5f13-4794-8e6f-662db5fdc2c0 tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4ddf20-bc06-46a0-8937-d4600699c568 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:11 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4ddf20-bc06-46a0-8937-d4600699c568 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41 Nov 02 10:59:11 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:11 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD" returned: 1 in 0.445s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] 18a6fceb-e50d-4438-b8fd-95bdd069da59 was raw, converting to qcow2 {{(pid=87084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:11 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce Nov 02 10:59:11 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:11 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1ecff899-3b74-4c56-8399-83b9cf3d565d tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-c35c142a-591d-4088-853a-6099f98f8e8f" returned: 0 in 0.279s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1ecff899-3b74-4c56-8399-83b9cf3d565d tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-c35c142a-591d-4088-853a-6099f98f8e8f" released by "delete_volume" :: held 0.827s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-1ecff899-3b74-4c56-8399-83b9cf3d565d tempest-ProjectMemberTests-1266221133 None] Created reservations ['0eb71429-8791-4bdd-bfca-c93e318f8857', '5d6acf9f-3fb1-402a-8cc5-fb1e8e7d0b06', '0142ef0d-ea84-449d-9803-680ede4956d8', 'cd577579-1293-44b7-8d65-71fcf52865db'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1ecff899-3b74-4c56-8399-83b9cf3d565d tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1ecff899-3b74-4c56-8399-83b9cf3d565d tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1ecff899-3b74-4c56-8399-83b9cf3d565d tempest-ProjectMemberTests-1266221133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1ecff899-3b74-4c56-8399-83b9cf3d565d tempest-ProjectMemberTests-1266221133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1ecff899-3b74-4c56-8399-83b9cf3d565d tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1ecff899-3b74-4c56-8399-83b9cf3d565d tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:11 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:11 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-25970569-5f13-4794-8e6f-662db5fdc2c0 tempest-VolumeDependencyTests-1727860628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4ddf20-bc06-46a0-8937-d4600699c568 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41" returned: 0 in 0.348s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:11 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-25970569-5f13-4794-8e6f-662db5fdc2c0 tempest-VolumeDependencyTests-1727860628 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41 is being set with open permissions: ugo+rw Nov 02 10:59:11 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-25970569-5f13-4794-8e6f-662db5fdc2c0 tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:11 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41 Nov 02 10:59:11 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:11 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:11 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce" returned: 0 in 0.558s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_18a6fceb-e50d-4438-b8fd-95bdd069da59_rs66dpsodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:59:11 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1ecff899-3b74-4c56-8399-83b9cf3d565d tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.335s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-1ecff899-3b74-4c56-8399-83b9cf3d565d tempest-ProjectMemberTests-1266221133 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:11 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1ecff899-3b74-4c56-8399-83b9cf3d565d tempest-ProjectMemberTests-1266221133 None] Deleted volume successfully. Nov 02 10:59:11 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce 1G Nov 02 10:59:11 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:11 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-25970569-5f13-4794-8e6f-662db5fdc2c0 tempest-VolumeDependencyTests-1727860628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41" returned: 0 in 0.328s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1ecff899-3b74-4c56-8399-83b9cf3d565d tempest-ProjectMemberTests-1266221133 None] Lock "cinder-c35c142a-591d-4088-853a-6099f98f8e8f-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-25970569-5f13-4794-8e6f-662db5fdc2c0 tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:11 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.info Nov 02 10:59:11 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Flow 'volume_create_manager' (f224e8da-8c00-443c-a216-4fb676d272b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e8172d-e53e-4c69-918b-5e5d45a29980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:12 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-25970569-5f13-4794-8e6f-662db5fdc2c0 tempest-VolumeDependencyTests-1727860628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.info" returned: 0 in 0.315s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:12 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-25970569-5f13-4794-8e6f-662db5fdc2c0 tempest-VolumeDependencyTests-1727860628 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.info is being set with open permissions: ugo+rw Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-25970569-5f13-4794-8e6f-662db5fdc2c0 tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e8172d-e53e-4c69-918b-5e5d45a29980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1837089918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2912852-4b2a-458f-b64d-5b09812930f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de43071a1c4348bf85c649c8f77ffcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:12Z,use_quota=True,user_id='eeeb85b0d7c743069682afbcc7ffccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e34801b-c7eb-4d9d-83a0-c015f722feeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:12 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.info Nov 02 10:59:12 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e34801b-c7eb-4d9d-83a0-c015f722feeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:12 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0444df4f-9bef-4254-83d8-11e41e44f571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0444df4f-9bef-4254-83d8-11e41e44f571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2912852-4b2a-458f-b64d-5b09812930f4', 'volume_name': 'volume-d2912852-4b2a-458f-b64d-5b09812930f4', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8d7c28-25e1-4b06-8e62-c32b2ceb91e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8d7c28-25e1-4b06-8e62-c32b2ceb91e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (116c18fc-9f76-42d7-a31d-56bc931063e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:12 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Volume d2912852-4b2a-458f-b64d-5b09812930f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2912852-4b2a-458f-b64d-5b09812930f4', 'volume_size': 1} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce 1G" returned: 0 in 0.521s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Downloaded image 18a6fceb-e50d-4438-b8fd-95bdd069da59 ((None, [{'url': 'file:///opt/stack/data/glance/images/18a6fceb-e50d-4438-b8fd-95bdd069da59', 'metadata': {}}])) to volume 142bb7c1-c735-46db-a4f6-5b0c2e9a6cce successfully. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Temporary image 18a6fceb-e50d-4438-b8fd-95bdd069da59 for user d580751459004195ae2c31f0977f6f3f is deleted. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Marking volume 142bb7c1-c735-46db-a4f6-5b0c2e9a6cce as bootable. {{(pid=87084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Copying metadata from image 18a6fceb-e50d-4438-b8fd-95bdd069da59 to 142bb7c1-c735-46db-a4f6-5b0c2e9a6cce. {{(pid=87084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Creating volume glance metadata for volume 142bb7c1-c735-46db-a4f6-5b0c2e9a6cce backed by image 18a6fceb-e50d-4438-b8fd-95bdd069da59 with: {'image_id': '18a6fceb-e50d-4438-b8fd-95bdd069da59', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'cfd3889d863fdbda3a6ae8914059d57f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a25e65-ee93-47e7-b83f-26a95c97a5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce', 'volume_size': 1, 'image_id': '18a6fceb-e50d-4438-b8fd-95bdd069da59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/18a6fceb-e50d-4438-b8fd-95bdd069da59', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cfd3889d863fdbda3a6ae8914059d57f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35ef9c01e05242c794ab128d464e98b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '67afec9fd854f57cc30902caf99905576804daf970d3878e469969f6c42e61bbab221b7c331a5d2c7c2f500cd7a642fdbf5b182c9c3481f1b56354edcd1f2136', 'id': '18a6fceb-e50d-4438-b8fd-95bdd069da59', 'created_at': datetime.datetime(2026, 11, 2, 9, 59, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 59, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/18a6fceb-e50d-4438-b8fd-95bdd069da59/file', 'properties': {}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fcd15a7-95e1-4554-8198-470157a90d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:12 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Volume volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce (142bb7c1-c735-46db-a4f6-5b0c2e9a6cce): created successfully Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fcd15a7-95e1-4554-8198-470157a90d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Flow 'volume_create_manager' (ea3d3025-7f6b-42c6-a31f-163a2a345130) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:12 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-308dfb79-2d00-4122-84ce-23500ef2e570 tempest-VolumeImageDependencyTests-1143382119 None] Created volume successfully. Nov 02 10:59:12 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-25970569-5f13-4794-8e6f-662db5fdc2c0 tempest-VolumeDependencyTests-1727860628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.info" returned: 0 in 0.265s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-25970569-5f13-4794-8e6f-662db5fdc2c0 tempest-VolumeDependencyTests-1727860628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.427s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.231s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1837089918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2912852-4b2a-458f-b64d-5b09812930f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de43071a1c4348bf85c649c8f77ffcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:12Z,use_quota=True,user_id='eeeb85b0d7c743069682afbcc7ffccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Creating volume d2912852-4b2a-458f-b64d-5b09812930f4 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:59:12 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:59:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:12 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4 1073741824 Nov 02 10:59:12 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:12 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-25970569-5f13-4794-8e6f-662db5fdc2c0 tempest-VolumeDependencyTests-1727860628 None] Create snapshot completed successfully Nov 02 10:59:13 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4 1073741824" returned: 0 in 0.532s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:13 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4 Nov 02 10:59:13 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3615a566-3951-47f6-b1e7-fd10faa4bb9e tempest-VolumeImageDependencyTests-1143382119 None] Acquiring lock "cinder-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3615a566-3951-47f6-b1e7-fd10faa4bb9e tempest-VolumeImageDependencyTests-1143382119 None] Lock "cinder-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3615a566-3951-47f6-b1e7-fd10faa4bb9e tempest-VolumeImageDependencyTests-1143382119 None] Acquiring lock "cinder-quobyte-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3615a566-3951-47f6-b1e7-fd10faa4bb9e tempest-VolumeImageDependencyTests-1143382119 None] Lock "cinder-quobyte-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0ee1b3-c60f-4d39-b4d1-96732d915f8c]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3615a566-3951-47f6-b1e7-fd10faa4bb9e tempest-VolumeImageDependencyTests-1143382119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:13 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4" returned: 0 in 0.325s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (116c18fc-9f76-42d7-a31d-56bc931063e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2912852-4b2a-458f-b64d-5b09812930f4', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:13 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce Nov 02 10:59:13 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86aacef8-24fb-4601-ae92-ac3770383872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:13 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Volume volume-d2912852-4b2a-458f-b64d-5b09812930f4 (d2912852-4b2a-458f-b64d-5b09812930f4): created successfully Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86aacef8-24fb-4601-ae92-ac3770383872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Flow 'volume_create_manager' (f224e8da-8c00-443c-a216-4fb676d272b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:13 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8d768042-6740-4fba-9e1d-68b3ad6cb72a tempest-ProjectMemberTests-1266221133 None] Created volume successfully. Nov 02 10:59:13 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3615a566-3951-47f6-b1e7-fd10faa4bb9e tempest-VolumeImageDependencyTests-1143382119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce" returned: 0 in 0.473s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3615a566-3951-47f6-b1e7-fd10faa4bb9e tempest-VolumeImageDependencyTests-1143382119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:13 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce Nov 02 10:59:13 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Flow 'volume_create_manager' (1459e72d-aab2-4167-b3b2-030af4c84a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb47f73e-4b0f-40e4-b002-c2750960db4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb47f73e-4b0f-40e4-b002-c2750960db4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1792662606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a33775bc-d10b-4028-9b05-d4d842d96f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d46ff4301347e198fafd0480f5b6d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6d969c93-0b3d-40b1-b26a-9e01d86ccc41,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:14Z,use_quota=True,user_id='0f5b1f8e05384c568ab92cae706afdd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c0b886-0622-4a1d-9bc3-cc689fdfbfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c0b886-0622-4a1d-9bc3-cc689fdfbfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4a746e-d9e2-495b-a194-aa19a2cf49c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4a746e-d9e2-495b-a194-aa19a2cf49c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a33775bc-d10b-4028-9b05-d4d842d96f8c', 'volume_name': 'volume-a33775bc-d10b-4028-9b05-d4d842d96f8c', 'volume_size': 1, 'snapshot_id': '6d969c93-0b3d-40b1-b26a-9e01d86ccc41'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8efddc2-1c5e-43f9-8b49-db9a70febfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8efddc2-1c5e-43f9-8b49-db9a70febfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c4ccf76-b982-4e08-94cb-2a84f3509557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:13 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Volume a33775bc-d10b-4028-9b05-d4d842d96f8c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a33775bc-d10b-4028-9b05-d4d842d96f8c', 'volume_size': 1, 'snapshot_id': '6d969c93-0b3d-40b1-b26a-9e01d86ccc41'} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Acquiring lock "cinder-quobyte-6d969c93-0b3d-40b1-b26a-9e01d86ccc41-a33775bc-d10b-4028-9b05-d4d842d96f8c" by "_create_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Lock "cinder-quobyte-6d969c93-0b3d-40b1-b26a-9e01d86ccc41-a33775bc-d10b-4028-9b05-d4d842d96f8c" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Creating volume a33775bc-d10b-4028-9b05-d4d842d96f8c from snapshot 6d969c93-0b3d-40b1-b26a-9e01d86ccc41 {{(pid=87084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Acquiring lock "cinder-quobyte-a33775bc-d10b-4028-9b05-d4d842d96f8c" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Lock "cinder-quobyte-a33775bc-d10b-4028-9b05-d4d842d96f8c" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] snapshot: 6d969c93-0b3d-40b1-b26a-9e01d86ccc41, volume: a33775bc-d10b-4028-9b05-d4d842d96f8c, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:59:14 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3615a566-3951-47f6-b1e7-fd10faa4bb9e tempest-VolumeImageDependencyTests-1143382119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce" returned: 0 in 0.290s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3615a566-3951-47f6-b1e7-fd10faa4bb9e tempest-VolumeImageDependencyTests-1143382119 None] Lock "cinder-quobyte-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce" released by "delete_volume" :: held 0.841s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8da2a1-0136-43d6-967c-df9e5df629c8]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-3615a566-3951-47f6-b1e7-fd10faa4bb9e tempest-VolumeImageDependencyTests-1143382119 None] Created reservations ['f7ef27e9-1400-4ee7-ac31-5f4f9a12ed43', 'bcdd2389-8ddf-47ef-a626-95b4b0fe76f2', 'a0712546-4ca9-4a1d-9bb1-053d004c84a5', '1e75a37a-4a1c-444b-abe8-0ac4baf0dff3'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:14 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41 Nov 02 10:59:14 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3615a566-3951-47f6-b1e7-fd10faa4bb9e tempest-VolumeImageDependencyTests-1143382119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3615a566-3951-47f6-b1e7-fd10faa4bb9e tempest-VolumeImageDependencyTests-1143382119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3615a566-3951-47f6-b1e7-fd10faa4bb9e tempest-VolumeImageDependencyTests-1143382119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3615a566-3951-47f6-b1e7-fd10faa4bb9e tempest-VolumeImageDependencyTests-1143382119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3615a566-3951-47f6-b1e7-fd10faa4bb9e tempest-VolumeImageDependencyTests-1143382119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3615a566-3951-47f6-b1e7-fd10faa4bb9e tempest-VolumeImageDependencyTests-1143382119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:14 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:59:14 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4f3a7d37-1765-4300-be4e-f2337eabd668 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:14 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3615a566-3951-47f6-b1e7-fd10faa4bb9e tempest-VolumeImageDependencyTests-1143382119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.343s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-3615a566-3951-47f6-b1e7-fd10faa4bb9e tempest-VolumeImageDependencyTests-1143382119 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3615a566-3951-47f6-b1e7-fd10faa4bb9e tempest-VolumeImageDependencyTests-1143382119 None] Deleted volume successfully. Nov 02 10:59:14 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41" returned: 0 in 0.545s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec4ddf20-bc06-46a0-8937-d4600699c568(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3615a566-3951-47f6-b1e7-fd10faa4bb9e tempest-VolumeImageDependencyTests-1143382119 None] Lock "cinder-142bb7c1-c735-46db-a4f6-5b0c2e9a6cce-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2b0c23-0597-4df1-b08f-a05d3d5415e6]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:14 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568 Nov 02 10:59:14 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:15 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568" returned: 0 in 0.413s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568 {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:59:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:59:15 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Path /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a33775bc-d10b-4028-9b05-d4d842d96f8c not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:59:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a33775bc-d10b-4028-9b05-d4d842d96f8c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:15 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a33775bc-d10b-4028-9b05-d4d842d96f8c Nov 02 10:59:15 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:20 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:59:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Flow 'volume_create_manager' (4a121dfe-6a79-4e8e-8d23-3a2e1e0bdc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139dcf96-d858-4432-80bd-80a45f0b8a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139dcf96-d858-4432-80bd-80a45f0b8a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28ec624-8951-4d40-afde-ffa5a57f3b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8048eff95b0540b095c6b34664d97d50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:21Z,use_quota=True,user_id='bdc3f88e45f347889b3b805ec0297493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00c8b91-100b-4db5-a0bb-94f39a0a6559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00c8b91-100b-4db5-a0bb-94f39a0a6559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2831e12-aef6-4d1f-96f3-fb5b930475f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2831e12-aef6-4d1f-96f3-fb5b930475f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd28ec624-8951-4d40-afde-ffa5a57f3b74', 'volume_name': 'volume-d28ec624-8951-4d40-afde-ffa5a57f3b74', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b26978-99fa-4873-91d0-7cbfc9c07bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b26978-99fa-4873-91d0-7cbfc9c07bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a21a250-aaf5-4b4a-816e-0ae271776eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:21 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Volume d28ec624-8951-4d40-afde-ffa5a57f3b74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d28ec624-8951-4d40-afde-ffa5a57f3b74', 'volume_size': 1} Nov 02 10:59:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:22 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a33775bc-d10b-4028-9b05-d4d842d96f8c" returned: 0 in 7.575s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:22 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Image conversion details: src /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568, size 1024.00 MB, duration 7.58 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a33775bc-d10b-4028-9b05-d4d842d96f8c {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:59:22 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Converted 1024.00 MB image at 135.16 MB/s Nov 02 10:59:22 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a33775bc-d10b-4028-9b05-d4d842d96f8c is being set with open permissions: ugo+rw Nov 02 10:59:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a33775bc-d10b-4028-9b05-d4d842d96f8c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:22 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a33775bc-d10b-4028-9b05-d4d842d96f8c Nov 02 10:59:22 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:22 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a33775bc-d10b-4028-9b05-d4d842d96f8c" returned: 0 in 0.258s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Lock "cinder-quobyte-a33775bc-d10b-4028-9b05-d4d842d96f8c" released by "_copy_volume_from_snapshot" :: held 8.902s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Lock "cinder-quobyte-6d969c93-0b3d-40b1-b26a-9e01d86ccc41-a33775bc-d10b-4028-9b05-d4d842d96f8c" released by "_create_volume_from_snapshot" :: held 8.976s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.993s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4f3a7d37-1765-4300-be4e-f2337eabd668 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.487s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4f3a7d37-1765-4300-be4e-f2337eabd668 tempest-ProjectMemberTests-1266221133 None] Creating offline snapshot 44472270-ec51-47ed-bcad-6c2cafbf5a84 of volume d2912852-4b2a-458f-b64d-5b09812930f4 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c4ccf76-b982-4e08-94cb-2a84f3509557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a33775bc-d10b-4028-9b05-d4d842d96f8c', 'volume_size': 1, 'snapshot_id': '6d969c93-0b3d-40b1-b26a-9e01d86ccc41'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f792750a-7402-4fb9-8353-8ae29b8e217d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71a82cd-5e2c-4ee9-aeb9-bd3d387b2fba]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4f3a7d37-1765-4300-be4e-f2337eabd668 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:23 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Volume volume-a33775bc-d10b-4028-9b05-d4d842d96f8c (a33775bc-d10b-4028-9b05-d4d842d96f8c): created successfully Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f792750a-7402-4fb9-8353-8ae29b8e217d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Flow 'volume_create_manager' (1459e72d-aab2-4167-b3b2-030af4c84a4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a70b0ab5-a40d-4cc4-8931-345ec6f0d627 tempest-VolumeDependencyTests-1727860628 None] Created volume successfully. Nov 02 10:59:23 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4 Nov 02 10:59:23 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:23 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4f3a7d37-1765-4300-be4e-f2337eabd668 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4" returned: 0 in 0.371s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4f3a7d37-1765-4300-be4e-f2337eabd668 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.44472270-ec51-47ed-bcad-6c2cafbf5a84 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:23 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.44472270-ec51-47ed-bcad-6c2cafbf5a84 1G Nov 02 10:59:23 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] Acquiring lock "cinder-6d969c93-0b3d-40b1-b26a-9e01d86ccc41-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] Lock "cinder-6d969c93-0b3d-40b1-b26a-9e01d86ccc41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] Acquiring lock "cinder-quobyte-ec4ddf20-bc06-46a0-8937-d4600699c568" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] Lock "cinder-quobyte-ec4ddf20-bc06-46a0-8937-d4600699c568" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] Acquiring lock "cinder-quobyte-6d969c93-0b3d-40b1-b26a-9e01d86ccc41" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] Lock "cinder-quobyte-6d969c93-0b3d-40b1-b26a-9e01d86ccc41" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] Deleting offline snapshot 6d969c93-0b3d-40b1-b26a-9e01d86ccc41 of volume ec4ddf20-bc06-46a0-8937-d4600699c568 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:59:23 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] snapshot_file for this snap is: volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4f3a7d37-1765-4300-be4e-f2337eabd668 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.44472270-ec51-47ed-bcad-6c2cafbf5a84 1G" returned: 0 in 0.525s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4f3a7d37-1765-4300-be4e-f2337eabd668 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2912852-4b2a-458f-b64d-5b09812930f4 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.44472270-ec51-47ed-bcad-6c2cafbf5a84 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4a9ff6-bc50-4677-a6fa-04f5dc89a55d]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:23 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2912852-4b2a-458f-b64d-5b09812930f4 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.44472270-ec51-47ed-bcad-6c2cafbf5a84 Nov 02 10:59:23 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:24 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41 Nov 02 10:59:24 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:24 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4f3a7d37-1765-4300-be4e-f2337eabd668 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2912852-4b2a-458f-b64d-5b09812930f4 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.44472270-ec51-47ed-bcad-6c2cafbf5a84" returned: 0 in 0.318s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:24 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-4f3a7d37-1765-4300-be4e-f2337eabd668 tempest-ProjectMemberTests-1266221133 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.44472270-ec51-47ed-bcad-6c2cafbf5a84 is being set with open permissions: ugo+rw Nov 02 10:59:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4f3a7d37-1765-4300-be4e-f2337eabd668 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.44472270-ec51-47ed-bcad-6c2cafbf5a84 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:24 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.44472270-ec51-47ed-bcad-6c2cafbf5a84 Nov 02 10:59:24 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:24 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41" returned: 0 in 0.406s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec4ddf20-bc06-46a0-8937-d4600699c568(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:59:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7fade6-7e34-4599-a791-ca98cd22df20]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:24 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:24 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568 Nov 02 10:59:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4f3a7d37-1765-4300-be4e-f2337eabd668 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.44472270-ec51-47ed-bcad-6c2cafbf5a84" returned: 0 in 0.259s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:24 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4f3a7d37-1765-4300-be4e-f2337eabd668 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:24 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.info Nov 02 10:59:24 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:24 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4f3a7d37-1765-4300-be4e-f2337eabd668 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.info" returned: 0 in 0.279s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:24 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-4f3a7d37-1765-4300-be4e-f2337eabd668 tempest-ProjectMemberTests-1266221133 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.info is being set with open permissions: ugo+rw Nov 02 10:59:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4f3a7d37-1765-4300-be4e-f2337eabd668 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:24 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.info Nov 02 10:59:24 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:25 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568" returned: 0 in 0.609s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:25 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41 Nov 02 10:59:25 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:25 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4f3a7d37-1765-4300-be4e-f2337eabd668 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.info" returned: 0 in 0.276s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4f3a7d37-1765-4300-be4e-f2337eabd668 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.116s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28ec624-8951-4d40-afde-ffa5a57f3b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8048eff95b0540b095c6b34664d97d50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:21Z,use_quota=True,user_id='bdc3f88e45f347889b3b805ec0297493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Creating volume d28ec624-8951-4d40-afde-ffa5a57f3b74 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:59:25 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d28ec624-8951-4d40-afde-ffa5a57f3b74 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:25 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d28ec624-8951-4d40-afde-ffa5a57f3b74 1073741824 Nov 02 10:59:25 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:25 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4f3a7d37-1765-4300-be4e-f2337eabd668 tempest-ProjectMemberTests-1266221133 None] Create snapshot completed successfully Nov 02 10:59:25 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41" returned: 0 in 0.387s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:25 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41 Nov 02 10:59:25 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:25 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d28ec624-8951-4d40-afde-ffa5a57f3b74 1073741824" returned: 0 in 0.493s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d28ec624-8951-4d40-afde-ffa5a57f3b74 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:25 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568.6d969c93-0b3d-40b1-b26a-9e01d86ccc41" returned: 0 in 0.310s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:25 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d28ec624-8951-4d40-afde-ffa5a57f3b74 Nov 02 10:59:25 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] Lock "cinder-quobyte-6d969c93-0b3d-40b1-b26a-9e01d86ccc41" released by "_delete_snapshot" :: held 1.849s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] Lock "cinder-quobyte-ec4ddf20-bc06-46a0-8937-d4600699c568" released by "delete_snapshot" :: held 1.875s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] Created reservations ['03ae0d1e-0b51-4be8-a14b-1e0f88d181a0', 'cefd094a-6ec9-42fb-b54d-64f38d8f6ed9', 'ed0cb650-b37f-4274-bbc5-f1fcb5a855e2', 'f4734e3b-0319-40b7-9cb7-60599bb56ff4'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:25 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] Delete snapshot completed successfully. Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f2e27766-601d-4545-a6e5-b6a95699b1aa tempest-VolumeDependencyTests-1727860628 None] Lock "cinder-6d969c93-0b3d-40b1-b26a-9e01d86ccc41-delete_snapshot" released by "delete_snapshot" :: held 2.064s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:25 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d28ec624-8951-4d40-afde-ffa5a57f3b74" returned: 0 in 0.285s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a21a250-aaf5-4b4a-816e-0ae271776eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d28ec624-8951-4d40-afde-ffa5a57f3b74', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083e3d6f-8b3e-4278-a3b7-be5cb7b3be0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:26 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Volume volume-d28ec624-8951-4d40-afde-ffa5a57f3b74 (d28ec624-8951-4d40-afde-ffa5a57f3b74): created successfully Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083e3d6f-8b3e-4278-a3b7-be5cb7b3be0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Flow 'volume_create_manager' (4a121dfe-6a79-4e8e-8d23-3a2e1e0bdc1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:26 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a68e105c-3e1b-4955-8a90-92f649d15a33 tempest-CinderUnicodeTest-564035072 None] Created volume successfully. Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-77c016a8-6a07-4e71-93f2-14f3c2e04dd6 tempest-VolumeDependencyTests-1727860628 None] Acquiring lock "cinder-ec4ddf20-bc06-46a0-8937-d4600699c568-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-44472270-ec51-47ed-bcad-6c2cafbf5a84-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-77c016a8-6a07-4e71-93f2-14f3c2e04dd6 tempest-VolumeDependencyTests-1727860628 None] Lock "cinder-ec4ddf20-bc06-46a0-8937-d4600699c568-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-44472270-ec51-47ed-bcad-6c2cafbf5a84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-d2912852-4b2a-458f-b64d-5b09812930f4" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-77c016a8-6a07-4e71-93f2-14f3c2e04dd6 tempest-VolumeDependencyTests-1727860628 None] Acquiring lock "cinder-quobyte-ec4ddf20-bc06-46a0-8937-d4600699c568" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-d2912852-4b2a-458f-b64d-5b09812930f4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-44472270-ec51-47ed-bcad-6c2cafbf5a84" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-77c016a8-6a07-4e71-93f2-14f3c2e04dd6 tempest-VolumeDependencyTests-1727860628 None] Lock "cinder-quobyte-ec4ddf20-bc06-46a0-8937-d4600699c568" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-44472270-ec51-47ed-bcad-6c2cafbf5a84" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] Deleting offline snapshot 44472270-ec51-47ed-bcad-6c2cafbf5a84 of volume d2912852-4b2a-458f-b64d-5b09812930f4 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] snapshot_file for this snap is: volume-d2912852-4b2a-458f-b64d-5b09812930f4.44472270-ec51-47ed-bcad-6c2cafbf5a84 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[74444d71-078b-4910-bc8e-60006626dd8d]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-77c016a8-6a07-4e71-93f2-14f3c2e04dd6 tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d4d50e-559f-4549-b975-c0db7a3fd015]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.44472270-ec51-47ed-bcad-6c2cafbf5a84 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:26 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568 Nov 02 10:59:26 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:26 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.44472270-ec51-47ed-bcad-6c2cafbf5a84 Nov 02 10:59:26 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:26 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-77c016a8-6a07-4e71-93f2-14f3c2e04dd6 tempest-VolumeDependencyTests-1727860628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568" returned: 0 in 0.387s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-77c016a8-6a07-4e71-93f2-14f3c2e04dd6 tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:26 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.44472270-ec51-47ed-bcad-6c2cafbf5a84" returned: 0 in 0.403s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2912852-4b2a-458f-b64d-5b09812930f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:59:26 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568 Nov 02 10:59:26 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab45cc5e-48d1-4b05-ab03-c2bcdcc0e3e7]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:26 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4 Nov 02 10:59:26 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:26 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-77c016a8-6a07-4e71-93f2-14f3c2e04dd6 tempest-VolumeDependencyTests-1727860628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ec4ddf20-bc06-46a0-8937-d4600699c568" returned: 0 in 0.270s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-77c016a8-6a07-4e71-93f2-14f3c2e04dd6 tempest-VolumeDependencyTests-1727860628 None] Lock "cinder-quobyte-ec4ddf20-bc06-46a0-8937-d4600699c568" released by "delete_volume" :: held 0.740s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-77c016a8-6a07-4e71-93f2-14f3c2e04dd6 tempest-VolumeDependencyTests-1727860628 None] Created reservations ['50614f38-1236-4fe8-8dbf-04b29be35c05', '833dd065-e1e1-48b8-94be-6d55cf995ef3', '5f437ad1-41ef-48e7-8298-c9d6b5836b00', 'ccc4d2f4-6a6d-41c2-bcdd-b0ccdfe789b9'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-77c016a8-6a07-4e71-93f2-14f3c2e04dd6 tempest-VolumeDependencyTests-1727860628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-77c016a8-6a07-4e71-93f2-14f3c2e04dd6 tempest-VolumeDependencyTests-1727860628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-77c016a8-6a07-4e71-93f2-14f3c2e04dd6 tempest-VolumeDependencyTests-1727860628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-77c016a8-6a07-4e71-93f2-14f3c2e04dd6 tempest-VolumeDependencyTests-1727860628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-77c016a8-6a07-4e71-93f2-14f3c2e04dd6 tempest-VolumeDependencyTests-1727860628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-77c016a8-6a07-4e71-93f2-14f3c2e04dd6 tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:27 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:59:27 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:27 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4" returned: 0 in 0.437s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.44472270-ec51-47ed-bcad-6c2cafbf5a84 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:27 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.44472270-ec51-47ed-bcad-6c2cafbf5a84 Nov 02 10:59:27 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f4efe44b-7586-44cf-8875-5058875430ad tempest-VolumeDependencyTests-1727860628 None] Acquiring lock "cinder-a33775bc-d10b-4028-9b05-d4d842d96f8c-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f4efe44b-7586-44cf-8875-5058875430ad tempest-VolumeDependencyTests-1727860628 None] Lock "cinder-a33775bc-d10b-4028-9b05-d4d842d96f8c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:27 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-77c016a8-6a07-4e71-93f2-14f3c2e04dd6 tempest-VolumeDependencyTests-1727860628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.340s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-77c016a8-6a07-4e71-93f2-14f3c2e04dd6 tempest-VolumeDependencyTests-1727860628 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f4efe44b-7586-44cf-8875-5058875430ad tempest-VolumeDependencyTests-1727860628 None] Acquiring lock "cinder-quobyte-a33775bc-d10b-4028-9b05-d4d842d96f8c" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:27 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-77c016a8-6a07-4e71-93f2-14f3c2e04dd6 tempest-VolumeDependencyTests-1727860628 None] Deleted volume successfully. Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f4efe44b-7586-44cf-8875-5058875430ad tempest-VolumeDependencyTests-1727860628 None] Lock "cinder-quobyte-a33775bc-d10b-4028-9b05-d4d842d96f8c" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-77c016a8-6a07-4e71-93f2-14f3c2e04dd6 tempest-VolumeDependencyTests-1727860628 None] Lock "cinder-ec4ddf20-bc06-46a0-8937-d4600699c568-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a686b51-a3b5-484e-a874-3cb7667b766a]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4efe44b-7586-44cf-8875-5058875430ad tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a33775bc-d10b-4028-9b05-d4d842d96f8c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:27 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a33775bc-d10b-4028-9b05-d4d842d96f8c Nov 02 10:59:27 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:27 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.44472270-ec51-47ed-bcad-6c2cafbf5a84" returned: 0 in 0.537s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.44472270-ec51-47ed-bcad-6c2cafbf5a84 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:27 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.44472270-ec51-47ed-bcad-6c2cafbf5a84 Nov 02 10:59:27 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:27 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:59:27 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Flow 'volume_create_manager' (a4503206-64b3-4e4f-b943-d80b4614e82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e35b88-b9ce-4447-a9ed-b13d4d395224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4efe44b-7586-44cf-8875-5058875430ad tempest-VolumeDependencyTests-1727860628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a33775bc-d10b-4028-9b05-d4d842d96f8c" returned: 0 in 0.511s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4efe44b-7586-44cf-8875-5058875430ad tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a33775bc-d10b-4028-9b05-d4d842d96f8c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:28 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4.44472270-ec51-47ed-bcad-6c2cafbf5a84" returned: 0 in 0.344s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:28 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a33775bc-d10b-4028-9b05-d4d842d96f8c Nov 02 10:59:28 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e35b88-b9ce-4447-a9ed-b13d4d395224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-169471478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91da41ac-9152-46d5-b58c-3c6fba9dc11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8048eff95b0540b095c6b34664d97d50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:28Z,use_quota=True,user_id='bdc3f88e45f347889b3b805ec0297493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9049507f-28c2-42fc-a26b-539854df9372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9049507f-28c2-42fc-a26b-539854df9372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524dad0b-241e-4e44-bd2a-82cc3be24f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524dad0b-241e-4e44-bd2a-82cc3be24f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91da41ac-9152-46d5-b58c-3c6fba9dc11b', 'volume_name': 'volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d60dcb9-4b62-41e2-9b00-3b26677690b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d60dcb9-4b62-41e2-9b00-3b26677690b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c680ac-e1f3-4613-a908-4ac9197f4a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:28 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Volume 91da41ac-9152-46d5-b58c-3c6fba9dc11b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b', 'volume_size': 1} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-169471478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91da41ac-9152-46d5-b58c-3c6fba9dc11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8048eff95b0540b095c6b34664d97d50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:28Z,use_quota=True,user_id='bdc3f88e45f347889b3b805ec0297493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Creating volume 91da41ac-9152-46d5-b58c-3c6fba9dc11b {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:59:28 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:28 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b 1073741824 Nov 02 10:59:28 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-44472270-ec51-47ed-bcad-6c2cafbf5a84" released by "_delete_snapshot" :: held 1.938s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-d2912852-4b2a-458f-b64d-5b09812930f4" released by "delete_snapshot" :: held 1.995s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] Created reservations ['3fe6529f-c315-4e95-af0b-a085ce3e78d9', 'bace018f-7a62-4a18-93d1-b51c383c95b7', '1f26497b-473b-4bbf-922e-5be66f09aa03', '71b347c8-df8f-491f-8a97-b2fd3fc3ad36'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:28 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] Delete snapshot completed successfully. Nov 02 10:59:28 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3b561939-52fe-4ba6-937d-f99260024ad5 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-44472270-ec51-47ed-bcad-6c2cafbf5a84-delete_snapshot" released by "delete_snapshot" :: held 2.201s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4efe44b-7586-44cf-8875-5058875430ad tempest-VolumeDependencyTests-1727860628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a33775bc-d10b-4028-9b05-d4d842d96f8c" returned: 0 in 0.337s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f4efe44b-7586-44cf-8875-5058875430ad tempest-VolumeDependencyTests-1727860628 None] Lock "cinder-quobyte-a33775bc-d10b-4028-9b05-d4d842d96f8c" released by "delete_volume" :: held 0.903s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-f4efe44b-7586-44cf-8875-5058875430ad tempest-VolumeDependencyTests-1727860628 None] Created reservations ['abaee2c5-4396-40d0-8dcf-1bc8b11193b3', '6a06a4bc-e14d-4c01-83e8-ea2e66aeabf4', 'cb557506-f616-419b-9b77-c32d991799b3', '8a4acf5d-0ad2-4dad-8e7f-471bd9b9a6de'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4efe44b-7586-44cf-8875-5058875430ad tempest-VolumeDependencyTests-1727860628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4efe44b-7586-44cf-8875-5058875430ad tempest-VolumeDependencyTests-1727860628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f4efe44b-7586-44cf-8875-5058875430ad tempest-VolumeDependencyTests-1727860628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f4efe44b-7586-44cf-8875-5058875430ad tempest-VolumeDependencyTests-1727860628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4efe44b-7586-44cf-8875-5058875430ad tempest-VolumeDependencyTests-1727860628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4efe44b-7586-44cf-8875-5058875430ad tempest-VolumeDependencyTests-1727860628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:28 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:59:28 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:28 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b 1073741824" returned: 0 in 0.526s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:28 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b Nov 02 10:59:28 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:28 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4efe44b-7586-44cf-8875-5058875430ad tempest-VolumeDependencyTests-1727860628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.309s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-f4efe44b-7586-44cf-8875-5058875430ad tempest-VolumeDependencyTests-1727860628 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:28 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f4efe44b-7586-44cf-8875-5058875430ad tempest-VolumeDependencyTests-1727860628 None] Deleted volume successfully. Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Flow 'volume_create_manager' (19f9698e-43ec-477c-b0f3-30bd41ab3162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3939d9ea-867f-476a-a951-63d22251679a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f4efe44b-7586-44cf-8875-5058875430ad tempest-VolumeDependencyTests-1727860628 None] Lock "cinder-a33775bc-d10b-4028-9b05-d4d842d96f8c-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3939d9ea-867f-476a-a951-63d22251679a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1499702881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b4a31c-d35e-4289-8adf-c7bbab66bb02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8afed4a85cad405da31d9ce6ee12914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:29Z,use_quota=True,user_id='9eb9e1e32bee4b2d9fb7786b3e8622f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54fcb90-da21-4773-91af-0afff7d93bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54fcb90-da21-4773-91af-0afff7d93bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400c06a1-a627-45f8-afd3-34fd0446201c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400c06a1-a627-45f8-afd3-34fd0446201c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9b4a31c-d35e-4289-8adf-c7bbab66bb02', 'volume_name': 'volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f6818c-44fb-4132-b861-e3ffb39c94b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f6818c-44fb-4132-b861-e3ffb39c94b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:28 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7dcfc0e-083c-4546-ba2e-a52de21c35d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:28 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Volume f9b4a31c-d35e-4289-8adf-c7bbab66bb02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02', 'volume_size': 1} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b" returned: 0 in 0.285s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1499702881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b4a31c-d35e-4289-8adf-c7bbab66bb02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8afed4a85cad405da31d9ce6ee12914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:29Z,use_quota=True,user_id='9eb9e1e32bee4b2d9fb7786b3e8622f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Creating volume f9b4a31c-d35e-4289-8adf-c7bbab66bb02 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:59:28 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c680ac-e1f3-4613-a908-4ac9197f4a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:29 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02 1073741824 Nov 02 10:59:29 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b27dbe2-0994-4a08-841e-8e6a681187e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:29 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Volume volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b (91da41ac-9152-46d5-b58c-3c6fba9dc11b): created successfully Nov 02 10:59:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b27dbe2-0994-4a08-841e-8e6a681187e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Flow 'volume_create_manager' (a4503206-64b3-4e4f-b943-d80b4614e82b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5513f327-16dc-437c-af2a-4409aebc5015 tempest-CinderUnicodeTest-564035072 None] Created volume successfully. Nov 02 10:59:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6db1beff-d34d-4d00-afee-51def0091b8d tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-d2912852-4b2a-458f-b64d-5b09812930f4-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:29 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02 1073741824" returned: 0 in 0.428s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6db1beff-d34d-4d00-afee-51def0091b8d tempest-ProjectMemberTests-1266221133 None] Lock "cinder-d2912852-4b2a-458f-b64d-5b09812930f4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6db1beff-d34d-4d00-afee-51def0091b8d tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-d2912852-4b2a-458f-b64d-5b09812930f4" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6db1beff-d34d-4d00-afee-51def0091b8d tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-d2912852-4b2a-458f-b64d-5b09812930f4" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:29 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02 Nov 02 10:59:29 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:29 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[143663d8-caa3-4136-ab16-1b9dcf866719]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6db1beff-d34d-4d00-afee-51def0091b8d tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:29 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4 Nov 02 10:59:29 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:29 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02" returned: 0 in 0.277s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:59:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7dcfc0e-083c-4546-ba2e-a52de21c35d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a92b704-d698-439f-873e-0fc3330baf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:29 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Volume volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02 (f9b4a31c-d35e-4289-8adf-c7bbab66bb02): created successfully Nov 02 10:59:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a92b704-d698-439f-873e-0fc3330baf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Flow 'volume_create_manager' (19f9698e-43ec-477c-b0f3-30bd41ab3162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-fa62f2c5-286f-469d-ad7a-6c1ffa17b6d6 tempest-ProjectReaderTests-597601906 None] Created volume successfully. Nov 02 10:59:29 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6db1beff-d34d-4d00-afee-51def0091b8d tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4" returned: 0 in 0.440s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6db1beff-d34d-4d00-afee-51def0091b8d tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:30 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4 Nov 02 10:59:30 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:30 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6db1beff-d34d-4d00-afee-51def0091b8d tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d2912852-4b2a-458f-b64d-5b09812930f4" returned: 0 in 0.278s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6db1beff-d34d-4d00-afee-51def0091b8d tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-d2912852-4b2a-458f-b64d-5b09812930f4" released by "delete_volume" :: held 0.818s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-40f292e8-bf2f-4e7b-8641-a53693c92634 tempest-CinderUnicodeTest-564035072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-40f292e8-bf2f-4e7b-8641-a53693c92634 tempest-CinderUnicodeTest-564035072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-40f292e8-bf2f-4e7b-8641-a53693c92634 tempest-CinderUnicodeTest-564035072 None] Creating offline snapshot 23b623cc-0432-4752-ab0c-2cb35e14f366 of volume 91da41ac-9152-46d5-b58c-3c6fba9dc11b {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:59:30 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4116f881-2c11-4ad6-bed1-c20ac4010396]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-40f292e8-bf2f-4e7b-8641-a53693c92634 tempest-CinderUnicodeTest-564035072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:30 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-6db1beff-d34d-4d00-afee-51def0091b8d tempest-ProjectMemberTests-1266221133 None] Created reservations ['f318c9e1-9254-42ff-aa60-69d09c8ea28f', 'd007cd67-8b1e-4c9a-aaa3-045642a7df06', '2ed8852b-8783-44ce-8d60-51fce45d0fc0', '9ef91e04-eba8-451c-b11d-e820e788f2ff'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6db1beff-d34d-4d00-afee-51def0091b8d tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6db1beff-d34d-4d00-afee-51def0091b8d tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6db1beff-d34d-4d00-afee-51def0091b8d tempest-ProjectMemberTests-1266221133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6db1beff-d34d-4d00-afee-51def0091b8d tempest-ProjectMemberTests-1266221133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6db1beff-d34d-4d00-afee-51def0091b8d tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6db1beff-d34d-4d00-afee-51def0091b8d tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:30 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b Nov 02 10:59:30 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:30 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:59:30 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:30 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:30 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-40f292e8-bf2f-4e7b-8641-a53693c92634 tempest-CinderUnicodeTest-564035072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b" returned: 0 in 0.465s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-40f292e8-bf2f-4e7b-8641-a53693c92634 tempest-CinderUnicodeTest-564035072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.23b623cc-0432-4752-ab0c-2cb35e14f366 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6db1beff-d34d-4d00-afee-51def0091b8d tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.341s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:30 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-6db1beff-d34d-4d00-afee-51def0091b8d tempest-ProjectMemberTests-1266221133 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:30 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6db1beff-d34d-4d00-afee-51def0091b8d tempest-ProjectMemberTests-1266221133 None] Deleted volume successfully. Nov 02 10:59:30 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.23b623cc-0432-4752-ab0c-2cb35e14f366 1G Nov 02 10:59:30 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6db1beff-d34d-4d00-afee-51def0091b8d tempest-ProjectMemberTests-1266221133 None] Lock "cinder-d2912852-4b2a-458f-b64d-5b09812930f4-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:31 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:59:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Flow 'volume_create_manager' (edead725-a5c0-4f35-9bca-75eb06436b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3e36fc-d0bc-4aad-a4c9-f319c8ad8714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3e36fc-d0bc-4aad-a4c9-f319c8ad8714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-377670603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c11a604-93c7-4ca1-9b94-ed007dd74355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de43071a1c4348bf85c649c8f77ffcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:31Z,use_quota=True,user_id='eeeb85b0d7c743069682afbcc7ffccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd390ca-a977-4922-a232-303dfefe3a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd390ca-a977-4922-a232-303dfefe3a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bef9578-9673-4892-a6d7-4b20b59fd81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bef9578-9673-4892-a6d7-4b20b59fd81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c11a604-93c7-4ca1-9b94-ed007dd74355', 'volume_name': 'volume-3c11a604-93c7-4ca1-9b94-ed007dd74355', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f55ba4-db94-4fd1-8ff4-81390e9dccc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f55ba4-db94-4fd1-8ff4-81390e9dccc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b34bd06-b518-42b5-9fa0-711d7cc5e6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:31 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Volume 3c11a604-93c7-4ca1-9b94-ed007dd74355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c11a604-93c7-4ca1-9b94-ed007dd74355', 'volume_size': 1} Nov 02 10:59:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-632cd394-b2d4-432a-8d5a-6b1358d4eaae tempest-ProjectReaderTests-597601906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:31 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-40f292e8-bf2f-4e7b-8641-a53693c92634 tempest-CinderUnicodeTest-564035072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.23b623cc-0432-4752-ab0c-2cb35e14f366 1G" returned: 0 in 0.579s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-40f292e8-bf2f-4e7b-8641-a53693c92634 tempest-CinderUnicodeTest-564035072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.23b623cc-0432-4752-ab0c-2cb35e14f366 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:31 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.23b623cc-0432-4752-ab0c-2cb35e14f366 Nov 02 10:59:31 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:31 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-40f292e8-bf2f-4e7b-8641-a53693c92634 tempest-CinderUnicodeTest-564035072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.23b623cc-0432-4752-ab0c-2cb35e14f366" returned: 0 in 0.303s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:31 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-40f292e8-bf2f-4e7b-8641-a53693c92634 tempest-CinderUnicodeTest-564035072 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.23b623cc-0432-4752-ab0c-2cb35e14f366 is being set with open permissions: ugo+rw Nov 02 10:59:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-40f292e8-bf2f-4e7b-8641-a53693c92634 tempest-CinderUnicodeTest-564035072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.23b623cc-0432-4752-ab0c-2cb35e14f366 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:31 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.23b623cc-0432-4752-ab0c-2cb35e14f366 Nov 02 10:59:31 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:31 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-40f292e8-bf2f-4e7b-8641-a53693c92634 tempest-CinderUnicodeTest-564035072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.23b623cc-0432-4752-ab0c-2cb35e14f366" returned: 0 in 0.262s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-40f292e8-bf2f-4e7b-8641-a53693c92634 tempest-CinderUnicodeTest-564035072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:32 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.info Nov 02 10:59:32 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:32 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-40f292e8-bf2f-4e7b-8641-a53693c92634 tempest-CinderUnicodeTest-564035072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.info" returned: 0 in 0.282s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:32 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-40f292e8-bf2f-4e7b-8641-a53693c92634 tempest-CinderUnicodeTest-564035072 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.info is being set with open permissions: ugo+rw Nov 02 10:59:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-40f292e8-bf2f-4e7b-8641-a53693c92634 tempest-CinderUnicodeTest-564035072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:32 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.info Nov 02 10:59:32 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:32 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-40f292e8-bf2f-4e7b-8641-a53693c92634 tempest-CinderUnicodeTest-564035072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.info" returned: 0 in 0.262s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-40f292e8-bf2f-4e7b-8641-a53693c92634 tempest-CinderUnicodeTest-564035072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.254s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.222s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-377670603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c11a604-93c7-4ca1-9b94-ed007dd74355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de43071a1c4348bf85c649c8f77ffcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:31Z,use_quota=True,user_id='eeeb85b0d7c743069682afbcc7ffccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:59:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Creating volume 3c11a604-93c7-4ca1-9b94-ed007dd74355 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:59:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:59:32 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:59:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:32 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355 1073741824 Nov 02 10:59:32 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:32 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-40f292e8-bf2f-4e7b-8641-a53693c92634 tempest-CinderUnicodeTest-564035072 None] Create snapshot completed successfully Nov 02 10:59:33 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355 1073741824" returned: 0 in 0.453s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:33 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355 Nov 02 10:59:33 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:33 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355" returned: 0 in 0.237s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-632cd394-b2d4-432a-8d5a-6b1358d4eaae tempest-ProjectReaderTests-597601906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.939s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b34bd06-b518-42b5-9fa0-711d7cc5e6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c11a604-93c7-4ca1-9b94-ed007dd74355', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02f10be-5be1-4016-973f-86ad14b3c40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-632cd394-b2d4-432a-8d5a-6b1358d4eaae tempest-ProjectReaderTests-597601906 None] Creating offline snapshot 0f4d9e73-1729-4c39-9c79-71bb67f3b588 of volume f9b4a31c-d35e-4289-8adf-c7bbab66bb02 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:59:33 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Volume volume-3c11a604-93c7-4ca1-9b94-ed007dd74355 (3c11a604-93c7-4ca1-9b94-ed007dd74355): created successfully Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02f10be-5be1-4016-973f-86ad14b3c40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Flow 'volume_create_manager' (edead725-a5c0-4f35-9bca-75eb06436b80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa65c2c-51f1-4e3c-baaa-b2efbc452a66]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-632cd394-b2d4-432a-8d5a-6b1358d4eaae tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-97b2ac71-e65b-49a0-baaf-5d0569ea91e8 tempest-ProjectMemberTests-1266221133 None] Created volume successfully. Nov 02 10:59:33 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02 Nov 02 10:59:33 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] Acquiring lock "cinder-23b623cc-0432-4752-ab0c-2cb35e14f366-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] Lock "cinder-23b623cc-0432-4752-ab0c-2cb35e14f366-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] Acquiring lock "cinder-quobyte-91da41ac-9152-46d5-b58c-3c6fba9dc11b" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] Lock "cinder-quobyte-91da41ac-9152-46d5-b58c-3c6fba9dc11b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] Acquiring lock "cinder-quobyte-23b623cc-0432-4752-ab0c-2cb35e14f366" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] Lock "cinder-quobyte-23b623cc-0432-4752-ab0c-2cb35e14f366" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] Deleting offline snapshot 23b623cc-0432-4752-ab0c-2cb35e14f366 of volume 91da41ac-9152-46d5-b58c-3c6fba9dc11b {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] snapshot_file for this snap is: volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.23b623cc-0432-4752-ab0c-2cb35e14f366 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7798a6-277a-45b1-a89e-14f9a22865d5]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.23b623cc-0432-4752-ab0c-2cb35e14f366 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:33 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.23b623cc-0432-4752-ab0c-2cb35e14f366 Nov 02 10:59:33 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:33 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-632cd394-b2d4-432a-8d5a-6b1358d4eaae tempest-ProjectReaderTests-597601906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02" returned: 0 in 0.383s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-632cd394-b2d4-432a-8d5a-6b1358d4eaae tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.0f4d9e73-1729-4c39-9c79-71bb67f3b588 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:33 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.0f4d9e73-1729-4c39-9c79-71bb67f3b588 1G Nov 02 10:59:33 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:33 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.23b623cc-0432-4752-ab0c-2cb35e14f366" returned: 0 in 0.392s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:59:34 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c80c924-c155-4a8d-9f8e-c61d20fc6990]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:34 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b Nov 02 10:59:34 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:34 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-632cd394-b2d4-432a-8d5a-6b1358d4eaae tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.0f4d9e73-1729-4c39-9c79-71bb67f3b588 1G" returned: 0 in 0.517s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-632cd394-b2d4-432a-8d5a-6b1358d4eaae tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.0f4d9e73-1729-4c39-9c79-71bb67f3b588 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:34 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.0f4d9e73-1729-4c39-9c79-71bb67f3b588 Nov 02 10:59:34 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:34 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b" returned: 0 in 0.443s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.23b623cc-0432-4752-ab0c-2cb35e14f366 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:34 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=217,cinder:UPDATE=306,cinder:DELETE=24,cinder:INSERT=77 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:59:34 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.23b623cc-0432-4752-ab0c-2cb35e14f366 Nov 02 10:59:34 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0031334c-cad0-4f1e-8fdb-429cee98ee35 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:34 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-632cd394-b2d4-432a-8d5a-6b1358d4eaae tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.0f4d9e73-1729-4c39-9c79-71bb67f3b588" returned: 0 in 0.418s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:34 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-632cd394-b2d4-432a-8d5a-6b1358d4eaae tempest-ProjectReaderTests-597601906 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.0f4d9e73-1729-4c39-9c79-71bb67f3b588 is being set with open permissions: ugo+rw Nov 02 10:59:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-632cd394-b2d4-432a-8d5a-6b1358d4eaae tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.0f4d9e73-1729-4c39-9c79-71bb67f3b588 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:34 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.0f4d9e73-1729-4c39-9c79-71bb67f3b588 Nov 02 10:59:34 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:34 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.23b623cc-0432-4752-ab0c-2cb35e14f366" returned: 0 in 0.487s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.23b623cc-0432-4752-ab0c-2cb35e14f366 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:34 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.23b623cc-0432-4752-ab0c-2cb35e14f366 Nov 02 10:59:34 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:34 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-632cd394-b2d4-432a-8d5a-6b1358d4eaae tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.0f4d9e73-1729-4c39-9c79-71bb67f3b588" returned: 0 in 0.297s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=293,cinder:SELECT=228,cinder:INSERT=82,cinder:DELETE=31 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-632cd394-b2d4-432a-8d5a-6b1358d4eaae tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:35 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.info Nov 02 10:59:35 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:35 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b.23b623cc-0432-4752-ab0c-2cb35e14f366" returned: 0 in 0.264s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] Lock "cinder-quobyte-23b623cc-0432-4752-ab0c-2cb35e14f366" released by "_delete_snapshot" :: held 1.711s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] Lock "cinder-quobyte-91da41ac-9152-46d5-b58c-3c6fba9dc11b" released by "delete_snapshot" :: held 1.737s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:35 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-632cd394-b2d4-432a-8d5a-6b1358d4eaae tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.info" returned: 0 in 0.292s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:35 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-632cd394-b2d4-432a-8d5a-6b1358d4eaae tempest-ProjectReaderTests-597601906 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.info is being set with open permissions: ugo+rw Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-632cd394-b2d4-432a-8d5a-6b1358d4eaae tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] Created reservations ['4779d6d9-0765-4f9a-9d8e-ef5a64a17562', '60276e32-6deb-49e8-bff4-70e9dc8add90', 'ca3f5418-a38b-4a5c-96a3-0b7c6628bdbf', 'd4cea23b-a5c0-4049-99e8-10e932fc0977'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:35 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.info Nov 02 10:59:35 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:35 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] Delete snapshot completed successfully. Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-52658d7b-6ee3-49d4-84ca-4a9ca8d53315 tempest-CinderUnicodeTest-564035072 None] Lock "cinder-23b623cc-0432-4752-ab0c-2cb35e14f366-delete_snapshot" released by "delete_snapshot" :: held 1.884s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:35 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-632cd394-b2d4-432a-8d5a-6b1358d4eaae tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.info" returned: 0 in 0.284s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-632cd394-b2d4-432a-8d5a-6b1358d4eaae tempest-ProjectReaderTests-597601906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.309s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0031334c-cad0-4f1e-8fdb-429cee98ee35 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.093s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-0031334c-cad0-4f1e-8fdb-429cee98ee35 tempest-ProjectMemberTests-1266221133 None] Creating offline snapshot d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd of volume 3c11a604-93c7-4ca1-9b94-ed007dd74355 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8498e7b3-64e4-4b3d-83ed-90d8440d21b1 tempest-CinderUnicodeTest-564035072 None] Acquiring lock "cinder-91da41ac-9152-46d5-b58c-3c6fba9dc11b-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:35 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-632cd394-b2d4-432a-8d5a-6b1358d4eaae tempest-ProjectReaderTests-597601906 None] Create snapshot completed successfully Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6122a0-7a8e-4e20-809b-151de63a46c0]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0031334c-cad0-4f1e-8fdb-429cee98ee35 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8498e7b3-64e4-4b3d-83ed-90d8440d21b1 tempest-CinderUnicodeTest-564035072 None] Lock "cinder-91da41ac-9152-46d5-b58c-3c6fba9dc11b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8498e7b3-64e4-4b3d-83ed-90d8440d21b1 tempest-CinderUnicodeTest-564035072 None] Acquiring lock "cinder-quobyte-91da41ac-9152-46d5-b58c-3c6fba9dc11b" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8498e7b3-64e4-4b3d-83ed-90d8440d21b1 tempest-CinderUnicodeTest-564035072 None] Lock "cinder-quobyte-91da41ac-9152-46d5-b58c-3c6fba9dc11b" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed251630-3d46-40ab-b3ff-9e32d06590ee]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8498e7b3-64e4-4b3d-83ed-90d8440d21b1 tempest-CinderUnicodeTest-564035072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:35 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355 Nov 02 10:59:35 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:35 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b Nov 02 10:59:35 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:36 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0031334c-cad0-4f1e-8fdb-429cee98ee35 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355" returned: 0 in 0.429s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0031334c-cad0-4f1e-8fdb-429cee98ee35 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:36 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd 1G Nov 02 10:59:36 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:36 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8498e7b3-64e4-4b3d-83ed-90d8440d21b1 tempest-CinderUnicodeTest-564035072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b" returned: 0 in 0.386s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8498e7b3-64e4-4b3d-83ed-90d8440d21b1 tempest-CinderUnicodeTest-564035072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:36 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b Nov 02 10:59:36 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:36 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8498e7b3-64e4-4b3d-83ed-90d8440d21b1 tempest-CinderUnicodeTest-564035072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-91da41ac-9152-46d5-b58c-3c6fba9dc11b" returned: 0 in 0.288s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8498e7b3-64e4-4b3d-83ed-90d8440d21b1 tempest-CinderUnicodeTest-564035072 None] Lock "cinder-quobyte-91da41ac-9152-46d5-b58c-3c6fba9dc11b" released by "delete_volume" :: held 0.742s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-8498e7b3-64e4-4b3d-83ed-90d8440d21b1 tempest-CinderUnicodeTest-564035072 None] Created reservations ['1c0f1377-49f7-45f6-b4e7-892d4475ebb5', '16880afe-8957-4fd0-9087-9557496e5072', '88e6cf3d-dfca-4353-967d-d4dcfa3a745f', '1d0ac1e8-6e4c-4a14-ac27-3ed42e2a6c8b'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:36 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0031334c-cad0-4f1e-8fdb-429cee98ee35 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd 1G" returned: 0 in 0.494s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0031334c-cad0-4f1e-8fdb-429cee98ee35 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c11a604-93c7-4ca1-9b94-ed007dd74355 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:36 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c11a604-93c7-4ca1-9b94-ed007dd74355 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd Nov 02 10:59:36 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8498e7b3-64e4-4b3d-83ed-90d8440d21b1 tempest-CinderUnicodeTest-564035072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8498e7b3-64e4-4b3d-83ed-90d8440d21b1 tempest-CinderUnicodeTest-564035072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8498e7b3-64e4-4b3d-83ed-90d8440d21b1 tempest-CinderUnicodeTest-564035072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8498e7b3-64e4-4b3d-83ed-90d8440d21b1 tempest-CinderUnicodeTest-564035072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8498e7b3-64e4-4b3d-83ed-90d8440d21b1 tempest-CinderUnicodeTest-564035072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8498e7b3-64e4-4b3d-83ed-90d8440d21b1 tempest-CinderUnicodeTest-564035072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:36 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:59:36 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-0f4d9e73-1729-4c39-9c79-71bb67f3b588-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] Lock "cinder-0f4d9e73-1729-4c39-9c79-71bb67f3b588-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-quobyte-f9b4a31c-d35e-4289-8adf-c7bbab66bb02" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4237d5c4-1564-4f18-9ff6-c76dd1406b10 tempest-CinderUnicodeTest-564035072 None] Acquiring lock "cinder-d28ec624-8951-4d40-afde-ffa5a57f3b74-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-f9b4a31c-d35e-4289-8adf-c7bbab66bb02" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-quobyte-0f4d9e73-1729-4c39-9c79-71bb67f3b588" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4237d5c4-1564-4f18-9ff6-c76dd1406b10 tempest-CinderUnicodeTest-564035072 None] Lock "cinder-d28ec624-8951-4d40-afde-ffa5a57f3b74-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-0f4d9e73-1729-4c39-9c79-71bb67f3b588" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] Deleting offline snapshot 0f4d9e73-1729-4c39-9c79-71bb67f3b588 of volume f9b4a31c-d35e-4289-8adf-c7bbab66bb02 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] snapshot_file for this snap is: volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.0f4d9e73-1729-4c39-9c79-71bb67f3b588 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:59:37 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0852f4b9-6d5d-466c-a142-b09bce023b1a]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.0f4d9e73-1729-4c39-9c79-71bb67f3b588 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8498e7b3-64e4-4b3d-83ed-90d8440d21b1 tempest-CinderUnicodeTest-564035072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.398s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-8498e7b3-64e4-4b3d-83ed-90d8440d21b1 tempest-CinderUnicodeTest-564035072 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:37 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8498e7b3-64e4-4b3d-83ed-90d8440d21b1 tempest-CinderUnicodeTest-564035072 None] Deleted volume successfully. Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0031334c-cad0-4f1e-8fdb-429cee98ee35 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c11a604-93c7-4ca1-9b94-ed007dd74355 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd" returned: 0 in 0.511s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:37 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-0031334c-cad0-4f1e-8fdb-429cee98ee35 tempest-ProjectMemberTests-1266221133 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd is being set with open permissions: ugo+rw Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0031334c-cad0-4f1e-8fdb-429cee98ee35 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4237d5c4-1564-4f18-9ff6-c76dd1406b10 tempest-CinderUnicodeTest-564035072 None] Acquiring lock "cinder-quobyte-d28ec624-8951-4d40-afde-ffa5a57f3b74" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8498e7b3-64e4-4b3d-83ed-90d8440d21b1 tempest-CinderUnicodeTest-564035072 None] Lock "cinder-91da41ac-9152-46d5-b58c-3c6fba9dc11b-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:37 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd Nov 02 10:59:37 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4237d5c4-1564-4f18-9ff6-c76dd1406b10 tempest-CinderUnicodeTest-564035072 None] Lock "cinder-quobyte-d28ec624-8951-4d40-afde-ffa5a57f3b74" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da67480-a51e-4d01-b349-c8d593c33eec]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4237d5c4-1564-4f18-9ff6-c76dd1406b10 tempest-CinderUnicodeTest-564035072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d28ec624-8951-4d40-afde-ffa5a57f3b74 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:37 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.0f4d9e73-1729-4c39-9c79-71bb67f3b588 Nov 02 10:59:37 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:37 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d28ec624-8951-4d40-afde-ffa5a57f3b74 Nov 02 10:59:37 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:37 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0031334c-cad0-4f1e-8fdb-429cee98ee35 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd" returned: 0 in 0.258s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0031334c-cad0-4f1e-8fdb-429cee98ee35 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:37 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.info Nov 02 10:59:37 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:37 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.0f4d9e73-1729-4c39-9c79-71bb67f3b588" returned: 0 in 0.439s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:59:37 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4237d5c4-1564-4f18-9ff6-c76dd1406b10 tempest-CinderUnicodeTest-564035072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d28ec624-8951-4d40-afde-ffa5a57f3b74" returned: 0 in 0.363s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4237d5c4-1564-4f18-9ff6-c76dd1406b10 tempest-CinderUnicodeTest-564035072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d28ec624-8951-4d40-afde-ffa5a57f3b74 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca0aa8c-1342-4ca1-94e4-0802fb93a85a]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:37 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d28ec624-8951-4d40-afde-ffa5a57f3b74 Nov 02 10:59:37 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:37 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02 Nov 02 10:59:37 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:37 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0031334c-cad0-4f1e-8fdb-429cee98ee35 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.info" returned: 0 in 0.292s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:37 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-0031334c-cad0-4f1e-8fdb-429cee98ee35 tempest-ProjectMemberTests-1266221133 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.info is being set with open permissions: ugo+rw Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0031334c-cad0-4f1e-8fdb-429cee98ee35 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:37 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.info Nov 02 10:59:37 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:37 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4237d5c4-1564-4f18-9ff6-c76dd1406b10 tempest-CinderUnicodeTest-564035072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-d28ec624-8951-4d40-afde-ffa5a57f3b74" returned: 0 in 0.259s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4237d5c4-1564-4f18-9ff6-c76dd1406b10 tempest-CinderUnicodeTest-564035072 None] Lock "cinder-quobyte-d28ec624-8951-4d40-afde-ffa5a57f3b74" released by "delete_volume" :: held 0.675s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-4237d5c4-1564-4f18-9ff6-c76dd1406b10 tempest-CinderUnicodeTest-564035072 None] Created reservations ['7965d305-f7ce-4f71-b813-32f93321810d', '540571f7-ce35-4943-b836-d76fbe27da51', '761288e3-c2f6-4933-92bd-987e7928d83f', '12fadd2c-3d6e-4faa-a3d7-26005618448a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4237d5c4-1564-4f18-9ff6-c76dd1406b10 tempest-CinderUnicodeTest-564035072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4237d5c4-1564-4f18-9ff6-c76dd1406b10 tempest-CinderUnicodeTest-564035072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4237d5c4-1564-4f18-9ff6-c76dd1406b10 tempest-CinderUnicodeTest-564035072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4237d5c4-1564-4f18-9ff6-c76dd1406b10 tempest-CinderUnicodeTest-564035072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4237d5c4-1564-4f18-9ff6-c76dd1406b10 tempest-CinderUnicodeTest-564035072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4237d5c4-1564-4f18-9ff6-c76dd1406b10 tempest-CinderUnicodeTest-564035072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:37 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02" returned: 0 in 0.399s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.0f4d9e73-1729-4c39-9c79-71bb67f3b588 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:37 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:59:37 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:37 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0031334c-cad0-4f1e-8fdb-429cee98ee35 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.info" returned: 0 in 0.292s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:38 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.0f4d9e73-1729-4c39-9c79-71bb67f3b588 Nov 02 10:59:38 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0031334c-cad0-4f1e-8fdb-429cee98ee35 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.420s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:38 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0031334c-cad0-4f1e-8fdb-429cee98ee35 tempest-ProjectMemberTests-1266221133 None] Create snapshot completed successfully Nov 02 10:59:38 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4237d5c4-1564-4f18-9ff6-c76dd1406b10 tempest-CinderUnicodeTest-564035072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.368s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:38 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-4237d5c4-1564-4f18-9ff6-c76dd1406b10 tempest-CinderUnicodeTest-564035072 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:38 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4237d5c4-1564-4f18-9ff6-c76dd1406b10 tempest-CinderUnicodeTest-564035072 None] Deleted volume successfully. Nov 02 10:59:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4237d5c4-1564-4f18-9ff6-c76dd1406b10 tempest-CinderUnicodeTest-564035072 None] Lock "cinder-d28ec624-8951-4d40-afde-ffa5a57f3b74-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:38 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.0f4d9e73-1729-4c39-9c79-71bb67f3b588" returned: 0 in 0.557s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.0f4d9e73-1729-4c39-9c79-71bb67f3b588 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:38 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.0f4d9e73-1729-4c39-9c79-71bb67f3b588 Nov 02 10:59:38 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:38 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02.0f4d9e73-1729-4c39-9c79-71bb67f3b588" returned: 0 in 0.318s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-0f4d9e73-1729-4c39-9c79-71bb67f3b588" released by "_delete_snapshot" :: held 1.864s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-3c11a604-93c7-4ca1-9b94-ed007dd74355" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-f9b4a31c-d35e-4289-8adf-c7bbab66bb02" released by "delete_snapshot" :: held 1.927s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-3c11a604-93c7-4ca1-9b94-ed007dd74355" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] Deleting offline snapshot d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd of volume 3c11a604-93c7-4ca1-9b94-ed007dd74355 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:59:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] snapshot_file for this snap is: volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:59:38 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3373c8c-3bc7-452e-b576-d196b14d6037]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:39 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] Created reservations ['8f43d4ff-77f6-4f5f-98f5-274691ca9b6e', '89b158b3-ebe4-4191-8b14-9d6205825269', '54a1e7a4-25c8-424e-902b-5a255ee745b6', '8ce9bafd-da4f-417f-b613-7dbe681da655'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:39 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] Delete snapshot completed successfully. Nov 02 10:59:39 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd Nov 02 10:59:39 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-32d798b7-0616-4ac1-8944-d37cab6b5e03 tempest-ProjectReaderTests-597601906 None] Lock "cinder-0f4d9e73-1729-4c39-9c79-71bb67f3b588-delete_snapshot" released by "delete_snapshot" :: held 2.188s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:39 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd" returned: 0 in 0.481s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c11a604-93c7-4ca1-9b94-ed007dd74355(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:59:39 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[126aa486-b767-4582-809e-1e4fdc87e909]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:39 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355 Nov 02 10:59:39 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:39 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355" returned: 0 in 0.459s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:40 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd Nov 02 10:59:40 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e05f6e33-b9cb-4444-9c56-e8a44d21f255 tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-f9b4a31c-d35e-4289-8adf-c7bbab66bb02-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e05f6e33-b9cb-4444-9c56-e8a44d21f255 tempest-ProjectReaderTests-597601906 None] Lock "cinder-f9b4a31c-d35e-4289-8adf-c7bbab66bb02-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e05f6e33-b9cb-4444-9c56-e8a44d21f255 tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-quobyte-f9b4a31c-d35e-4289-8adf-c7bbab66bb02" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e05f6e33-b9cb-4444-9c56-e8a44d21f255 tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-f9b4a31c-d35e-4289-8adf-c7bbab66bb02" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:40 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a140ca-0eb8-4306-a759-b3ed5a5d570b]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e05f6e33-b9cb-4444-9c56-e8a44d21f255 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:40 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd" returned: 0 in 0.430s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:40 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd Nov 02 10:59:40 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:40 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02 Nov 02 10:59:40 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:40 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355.d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd" returned: 0 in 0.298s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd" released by "_delete_snapshot" :: held 1.809s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-3c11a604-93c7-4ca1-9b94-ed007dd74355" released by "delete_snapshot" :: held 1.850s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:40 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e05f6e33-b9cb-4444-9c56-e8a44d21f255 tempest-ProjectReaderTests-597601906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02" returned: 0 in 0.449s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e05f6e33-b9cb-4444-9c56-e8a44d21f255 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:40 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02 Nov 02 10:59:40 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:40 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] Created reservations ['63da47a0-072f-4e67-b53d-9efcb8ac87b3', 'a1cca100-4b48-4e57-af8e-c8aa34598f64', '9410ec39-9407-4091-aa47-a4f4bea476a1', 'b6cb0869-b264-48c8-a37b-0ad0cb7f89e0'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] Delete snapshot completed successfully. Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a239af20-da0e-44f5-967d-ba6ca1eac291 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-d0aeaaf5-ffa5-4eb8-94e5-abfab63a3bfd-delete_snapshot" released by "delete_snapshot" :: held 2.156s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:41 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e05f6e33-b9cb-4444-9c56-e8a44d21f255 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-f9b4a31c-d35e-4289-8adf-c7bbab66bb02" returned: 0 in 0.366s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e05f6e33-b9cb-4444-9c56-e8a44d21f255 tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-f9b4a31c-d35e-4289-8adf-c7bbab66bb02" released by "delete_volume" :: held 0.897s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-e05f6e33-b9cb-4444-9c56-e8a44d21f255 tempest-ProjectReaderTests-597601906 None] Created reservations ['13fed801-ce46-4172-9f31-6d79d7c86c40', '527129f7-bd9d-4c1b-a58d-d1a21d81f4b2', '10e162b4-7eeb-4bba-a629-6088d08fd624', '408e479d-5b67-4adb-be8b-c03b4ed8acfa'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e05f6e33-b9cb-4444-9c56-e8a44d21f255 tempest-ProjectReaderTests-597601906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e05f6e33-b9cb-4444-9c56-e8a44d21f255 tempest-ProjectReaderTests-597601906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e05f6e33-b9cb-4444-9c56-e8a44d21f255 tempest-ProjectReaderTests-597601906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e05f6e33-b9cb-4444-9c56-e8a44d21f255 tempest-ProjectReaderTests-597601906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e05f6e33-b9cb-4444-9c56-e8a44d21f255 tempest-ProjectReaderTests-597601906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e05f6e33-b9cb-4444-9c56-e8a44d21f255 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:41 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:59:41 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:41 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e05f6e33-b9cb-4444-9c56-e8a44d21f255 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.297s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-e05f6e33-b9cb-4444-9c56-e8a44d21f255 tempest-ProjectReaderTests-597601906 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e05f6e33-b9cb-4444-9c56-e8a44d21f255 tempest-ProjectReaderTests-597601906 None] Deleted volume successfully. Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e05f6e33-b9cb-4444-9c56-e8a44d21f255 tempest-ProjectReaderTests-597601906 None] Lock "cinder-f9b4a31c-d35e-4289-8adf-c7bbab66bb02-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Flow 'volume_create_manager' (6deb9067-9d8e-4c28-ba89-2d8799ec6f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a5b614-9414-469d-b07a-b84f44f9f911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a5b614-9414-469d-b07a-b84f44f9f911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842035303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8afed4a85cad405da31d9ce6ee12914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:42Z,use_quota=True,user_id='9eb9e1e32bee4b2d9fb7786b3e8622f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81f89ac-f8de-4897-bf20-3f1343b3bc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81f89ac-f8de-4897-bf20-3f1343b3bc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806732e1-5bea-427d-9029-60c50bddd48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806732e1-5bea-427d-9029-60c50bddd48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a', 'volume_name': 'volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e3d9e2-544e-438d-a4df-5a458eb9f1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e3d9e2-544e-438d-a4df-5a458eb9f1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5c7b58-18ca-45ff-8885-0f979ffe481c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:42 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Volume 6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a', 'volume_size': 1} Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842035303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8afed4a85cad405da31d9ce6ee12914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:42Z,use_quota=True,user_id='9eb9e1e32bee4b2d9fb7786b3e8622f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Creating volume 6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:59:42 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:42 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a 1073741824 Nov 02 10:59:42 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d477abf2-d2a9-4f41-b38f-d9c087eccd29 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-3c11a604-93c7-4ca1-9b94-ed007dd74355-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d477abf2-d2a9-4f41-b38f-d9c087eccd29 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-3c11a604-93c7-4ca1-9b94-ed007dd74355-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d477abf2-d2a9-4f41-b38f-d9c087eccd29 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-3c11a604-93c7-4ca1-9b94-ed007dd74355" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d477abf2-d2a9-4f41-b38f-d9c087eccd29 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-3c11a604-93c7-4ca1-9b94-ed007dd74355" acquired by "delete_volume" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[de58326d-6370-46ca-8fd1-2f61786942bc]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d477abf2-d2a9-4f41-b38f-d9c087eccd29 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:42 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355 Nov 02 10:59:42 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:42 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a 1073741824" returned: 0 in 0.638s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:42 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d477abf2-d2a9-4f41-b38f-d9c087eccd29 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355" returned: 0 in 0.520s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d477abf2-d2a9-4f41-b38f-d9c087eccd29 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:42 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a Nov 02 10:59:42 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:42 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355 Nov 02 10:59:42 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:43 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a" returned: 0 in 0.304s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:59:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5c7b58-18ca-45ff-8885-0f979ffe481c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6bd22e-fae9-42be-8acc-3b464f5cf701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:43 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Volume volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a (6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a): created successfully Nov 02 10:59:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6bd22e-fae9-42be-8acc-3b464f5cf701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Flow 'volume_create_manager' (6deb9067-9d8e-4c28-ba89-2d8799ec6f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c5b4f327-3e90-40cc-bd2e-369772fd3218 tempest-ProjectReaderTests-597601906 None] Created volume successfully. Nov 02 10:59:43 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d477abf2-d2a9-4f41-b38f-d9c087eccd29 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3c11a604-93c7-4ca1-9b94-ed007dd74355" returned: 0 in 0.351s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d477abf2-d2a9-4f41-b38f-d9c087eccd29 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-3c11a604-93c7-4ca1-9b94-ed007dd74355" released by "delete_volume" :: held 0.949s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:43 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-d477abf2-d2a9-4f41-b38f-d9c087eccd29 tempest-ProjectMemberTests-1266221133 None] Created reservations ['9a29fb75-e273-492e-9d55-edff918bc2e2', '2d3558c4-761a-48cb-abf0-ce7668a23e0c', '68de2ece-79c2-4753-afcf-52e802d273c9', '638419d1-718a-4941-a5d7-e2e787f5da2d'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d477abf2-d2a9-4f41-b38f-d9c087eccd29 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d477abf2-d2a9-4f41-b38f-d9c087eccd29 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d477abf2-d2a9-4f41-b38f-d9c087eccd29 tempest-ProjectMemberTests-1266221133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d477abf2-d2a9-4f41-b38f-d9c087eccd29 tempest-ProjectMemberTests-1266221133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d477abf2-d2a9-4f41-b38f-d9c087eccd29 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d477abf2-d2a9-4f41-b38f-d9c087eccd29 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:43 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:59:43 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:43 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d477abf2-d2a9-4f41-b38f-d9c087eccd29 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.247s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:43 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-d477abf2-d2a9-4f41-b38f-d9c087eccd29 tempest-ProjectMemberTests-1266221133 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d477abf2-d2a9-4f41-b38f-d9c087eccd29 tempest-ProjectMemberTests-1266221133 None] Deleted volume successfully. Nov 02 10:59:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d477abf2-d2a9-4f41-b38f-d9c087eccd29 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-3c11a604-93c7-4ca1-9b94-ed007dd74355-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-30b4b328-0bd7-4fa3-8ef9-b4a236688b08 tempest-ProjectReaderTests-597601906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-30b4b328-0bd7-4fa3-8ef9-b4a236688b08 tempest-ProjectReaderTests-597601906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-30b4b328-0bd7-4fa3-8ef9-b4a236688b08 tempest-ProjectReaderTests-597601906 None] Creating offline snapshot 09ef6f10-e8b8-4ada-a9e8-c768d3a67012 of volume 6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:59:44 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cb098f-89b4-45e2-915c-1694eaa47aba]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30b4b328-0bd7-4fa3-8ef9-b4a236688b08 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:44 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a Nov 02 10:59:44 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:44 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30b4b328-0bd7-4fa3-8ef9-b4a236688b08 tempest-ProjectReaderTests-597601906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a" returned: 0 in 0.404s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30b4b328-0bd7-4fa3-8ef9-b4a236688b08 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.09ef6f10-e8b8-4ada-a9e8-c768d3a67012 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:44 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.09ef6f10-e8b8-4ada-a9e8-c768d3a67012 1G Nov 02 10:59:44 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:44 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:59:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Flow 'volume_create_manager' (317f2634-33a4-450a-bad4-9af7f4890858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba1b062c-bc7d-45f7-9b3b-60fba8f0b683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba1b062c-bc7d-45f7-9b3b-60fba8f0b683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1079827664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a366856-2342-4e29-b566-243eb556cb8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de43071a1c4348bf85c649c8f77ffcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:45Z,use_quota=True,user_id='eeeb85b0d7c743069682afbcc7ffccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (968f45b1-3534-4c1a-8871-ce2e702cab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (968f45b1-3534-4c1a-8871-ce2e702cab4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767a9438-8227-46c5-a07d-4d0a219c240a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767a9438-8227-46c5-a07d-4d0a219c240a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a366856-2342-4e29-b566-243eb556cb8e', 'volume_name': 'volume-4a366856-2342-4e29-b566-243eb556cb8e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ce1665-4a19-4b51-af4e-6ed9c13dbce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ce1665-4a19-4b51-af4e-6ed9c13dbce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9029f331-baf6-4775-8118-37867e8c2ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:45 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Volume 4a366856-2342-4e29-b566-243eb556cb8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a366856-2342-4e29-b566-243eb556cb8e', 'volume_size': 1} Nov 02 10:59:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:45 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30b4b328-0bd7-4fa3-8ef9-b4a236688b08 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.09ef6f10-e8b8-4ada-a9e8-c768d3a67012 1G" returned: 0 in 0.556s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30b4b328-0bd7-4fa3-8ef9-b4a236688b08 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.09ef6f10-e8b8-4ada-a9e8-c768d3a67012 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:45 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.09ef6f10-e8b8-4ada-a9e8-c768d3a67012 Nov 02 10:59:45 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:45 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30b4b328-0bd7-4fa3-8ef9-b4a236688b08 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.09ef6f10-e8b8-4ada-a9e8-c768d3a67012" returned: 0 in 0.326s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:45 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-30b4b328-0bd7-4fa3-8ef9-b4a236688b08 tempest-ProjectReaderTests-597601906 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.09ef6f10-e8b8-4ada-a9e8-c768d3a67012 is being set with open permissions: ugo+rw Nov 02 10:59:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30b4b328-0bd7-4fa3-8ef9-b4a236688b08 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.09ef6f10-e8b8-4ada-a9e8-c768d3a67012 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:45 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.09ef6f10-e8b8-4ada-a9e8-c768d3a67012 Nov 02 10:59:45 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:45 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30b4b328-0bd7-4fa3-8ef9-b4a236688b08 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.09ef6f10-e8b8-4ada-a9e8-c768d3a67012" returned: 0 in 0.255s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30b4b328-0bd7-4fa3-8ef9-b4a236688b08 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:45 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.info Nov 02 10:59:45 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:46 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30b4b328-0bd7-4fa3-8ef9-b4a236688b08 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.info" returned: 0 in 0.259s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:46 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-30b4b328-0bd7-4fa3-8ef9-b4a236688b08 tempest-ProjectReaderTests-597601906 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.info is being set with open permissions: ugo+rw Nov 02 10:59:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30b4b328-0bd7-4fa3-8ef9-b4a236688b08 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:46 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.info Nov 02 10:59:46 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:46 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30b4b328-0bd7-4fa3-8ef9-b4a236688b08 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.info" returned: 0 in 0.238s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-30b4b328-0bd7-4fa3-8ef9-b4a236688b08 tempest-ProjectReaderTests-597601906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.116s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.259s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1079827664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a366856-2342-4e29-b566-243eb556cb8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de43071a1c4348bf85c649c8f77ffcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:45Z,use_quota=True,user_id='eeeb85b0d7c743069682afbcc7ffccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:59:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Creating volume 4a366856-2342-4e29-b566-243eb556cb8e {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:59:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:59:46 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:59:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:46 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e 1073741824 Nov 02 10:59:46 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:46 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-30b4b328-0bd7-4fa3-8ef9-b4a236688b08 tempest-ProjectReaderTests-597601906 None] Create snapshot completed successfully Nov 02 10:59:46 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e 1073741824" returned: 0 in 0.530s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:46 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e Nov 02 10:59:46 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:47 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e" returned: 0 in 0.277s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9029f331-baf6-4775-8118-37867e8c2ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a366856-2342-4e29-b566-243eb556cb8e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68519ac-692e-4df0-8b93-d1d57c34cbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:47 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Volume volume-4a366856-2342-4e29-b566-243eb556cb8e (4a366856-2342-4e29-b566-243eb556cb8e): created successfully Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68519ac-692e-4df0-8b93-d1d57c34cbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Flow 'volume_create_manager' (317f2634-33a4-450a-bad4-9af7f4890858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-347788ff-33bd-4e08-ad36-2ba0347b550c tempest-ProjectMemberTests-1266221133 None] Created volume successfully. Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-09ef6f10-e8b8-4ada-a9e8-c768d3a67012-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] Lock "cinder-09ef6f10-e8b8-4ada-a9e8-c768d3a67012-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-quobyte-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-quobyte-09ef6f10-e8b8-4ada-a9e8-c768d3a67012" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-09ef6f10-e8b8-4ada-a9e8-c768d3a67012" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] Deleting offline snapshot 09ef6f10-e8b8-4ada-a9e8-c768d3a67012 of volume 6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] snapshot_file for this snap is: volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.09ef6f10-e8b8-4ada-a9e8-c768d3a67012 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da46c7c-42a4-4e1c-b1d7-739372048558]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.09ef6f10-e8b8-4ada-a9e8-c768d3a67012 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:47 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.09ef6f10-e8b8-4ada-a9e8-c768d3a67012 Nov 02 10:59:47 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:47 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.09ef6f10-e8b8-4ada-a9e8-c768d3a67012" returned: 0 in 0.371s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[af031f20-6991-4bfb-97cf-ea958f7a85b5]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:48 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a Nov 02 10:59:48 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9939fb31-8242-4fb3-80a1-7bf4f640c669 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9939fb31-8242-4fb3-80a1-7bf4f640c669 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9939fb31-8242-4fb3-80a1-7bf4f640c669 tempest-ProjectMemberTests-1266221133 None] Creating offline snapshot fd57a68b-bb74-4e59-964a-0c4125a82b4e of volume 4a366856-2342-4e29-b566-243eb556cb8e {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:59:48 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b841500b-d0c8-4d79-a5d7-39443ec584ec]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9939fb31-8242-4fb3-80a1-7bf4f640c669 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:48 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e Nov 02 10:59:48 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:48 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a" returned: 0 in 0.499s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.09ef6f10-e8b8-4ada-a9e8-c768d3a67012 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:48 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.09ef6f10-e8b8-4ada-a9e8-c768d3a67012 Nov 02 10:59:48 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:48 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9939fb31-8242-4fb3-80a1-7bf4f640c669 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e" returned: 0 in 0.465s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9939fb31-8242-4fb3-80a1-7bf4f640c669 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.fd57a68b-bb74-4e59-964a-0c4125a82b4e 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:48 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.fd57a68b-bb74-4e59-964a-0c4125a82b4e 1G Nov 02 10:59:48 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:48 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.09ef6f10-e8b8-4ada-a9e8-c768d3a67012" returned: 0 in 0.502s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.09ef6f10-e8b8-4ada-a9e8-c768d3a67012 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:49 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.09ef6f10-e8b8-4ada-a9e8-c768d3a67012 Nov 02 10:59:49 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:49 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a.09ef6f10-e8b8-4ada-a9e8-c768d3a67012" returned: 0 in 0.336s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:49 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9939fb31-8242-4fb3-80a1-7bf4f640c669 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.fd57a68b-bb74-4e59-964a-0c4125a82b4e 1G" returned: 0 in 0.567s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9939fb31-8242-4fb3-80a1-7bf4f640c669 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a366856-2342-4e29-b566-243eb556cb8e -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.fd57a68b-bb74-4e59-964a-0c4125a82b4e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-09ef6f10-e8b8-4ada-a9e8-c768d3a67012" released by "_delete_snapshot" :: held 1.839s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a" released by "delete_snapshot" :: held 1.871s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:49 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a366856-2342-4e29-b566-243eb556cb8e -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.fd57a68b-bb74-4e59-964a-0c4125a82b4e Nov 02 10:59:49 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:49 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] Created reservations ['198aa2b1-c570-4a91-8cc4-4589198d6410', 'bd6d1ea8-e566-4b66-8585-c092a86e5afc', '8de2d730-8460-4e32-b57f-0695ef5043a4', '0717921b-1f9d-434d-b917-ffa8ecb54b01'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] Delete snapshot completed successfully. Nov 02 10:59:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-38f79618-d3fe-426a-8f85-59f9a555de9f tempest-ProjectReaderTests-597601906 None] Lock "cinder-09ef6f10-e8b8-4ada-a9e8-c768d3a67012-delete_snapshot" released by "delete_snapshot" :: held 2.025s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f09e10d1-3d0a-42d7-9195-b96b8daf6f90 tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f09e10d1-3d0a-42d7-9195-b96b8daf6f90 tempest-ProjectReaderTests-597601906 None] Lock "cinder-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:49 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9939fb31-8242-4fb3-80a1-7bf4f640c669 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a366856-2342-4e29-b566-243eb556cb8e -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.fd57a68b-bb74-4e59-964a-0c4125a82b4e" returned: 0 in 0.400s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:49 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-9939fb31-8242-4fb3-80a1-7bf4f640c669 tempest-ProjectMemberTests-1266221133 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.fd57a68b-bb74-4e59-964a-0c4125a82b4e is being set with open permissions: ugo+rw Nov 02 10:59:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9939fb31-8242-4fb3-80a1-7bf4f640c669 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.fd57a68b-bb74-4e59-964a-0c4125a82b4e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f09e10d1-3d0a-42d7-9195-b96b8daf6f90 tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-quobyte-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:49 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.fd57a68b-bb74-4e59-964a-0c4125a82b4e Nov 02 10:59:49 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f09e10d1-3d0a-42d7-9195-b96b8daf6f90 tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:49 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65e9f70-bed2-4638-853e-0df49d91fbf9]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f09e10d1-3d0a-42d7-9195-b96b8daf6f90 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:49 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a Nov 02 10:59:49 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:50 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9939fb31-8242-4fb3-80a1-7bf4f640c669 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.fd57a68b-bb74-4e59-964a-0c4125a82b4e" returned: 0 in 0.322s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9939fb31-8242-4fb3-80a1-7bf4f640c669 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:50 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.info Nov 02 10:59:50 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:50 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f09e10d1-3d0a-42d7-9195-b96b8daf6f90 tempest-ProjectReaderTests-597601906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a" returned: 0 in 0.494s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f09e10d1-3d0a-42d7-9195-b96b8daf6f90 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:50 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a Nov 02 10:59:50 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:50 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9939fb31-8242-4fb3-80a1-7bf4f640c669 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.info" returned: 0 in 0.347s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:50 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-9939fb31-8242-4fb3-80a1-7bf4f640c669 tempest-ProjectMemberTests-1266221133 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.info is being set with open permissions: ugo+rw Nov 02 10:59:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9939fb31-8242-4fb3-80a1-7bf4f640c669 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:50 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.info Nov 02 10:59:50 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:50 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f09e10d1-3d0a-42d7-9195-b96b8daf6f90 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a" returned: 0 in 0.343s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f09e10d1-3d0a-42d7-9195-b96b8daf6f90 tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a" released by "delete_volume" :: held 0.945s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:50 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9939fb31-8242-4fb3-80a1-7bf4f640c669 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.info" returned: 0 in 0.349s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9939fb31-8242-4fb3-80a1-7bf4f640c669 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.560s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:50 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9939fb31-8242-4fb3-80a1-7bf4f640c669 tempest-ProjectMemberTests-1266221133 None] Create snapshot completed successfully Nov 02 10:59:50 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-f09e10d1-3d0a-42d7-9195-b96b8daf6f90 tempest-ProjectReaderTests-597601906 None] Created reservations ['e423d363-81dc-47ae-8d8a-72b00a2bcda0', '706d65f9-44c8-4c67-a2ea-2a9dc672e51f', '0486d4b1-7811-47ae-b571-fe30b6957f78', '2797985e-2ee9-4527-8de5-9c2ce97342c6'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f09e10d1-3d0a-42d7-9195-b96b8daf6f90 tempest-ProjectReaderTests-597601906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f09e10d1-3d0a-42d7-9195-b96b8daf6f90 tempest-ProjectReaderTests-597601906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f09e10d1-3d0a-42d7-9195-b96b8daf6f90 tempest-ProjectReaderTests-597601906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f09e10d1-3d0a-42d7-9195-b96b8daf6f90 tempest-ProjectReaderTests-597601906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f09e10d1-3d0a-42d7-9195-b96b8daf6f90 tempest-ProjectReaderTests-597601906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f09e10d1-3d0a-42d7-9195-b96b8daf6f90 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:51 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:59:51 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:51 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f09e10d1-3d0a-42d7-9195-b96b8daf6f90 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.267s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:51 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-f09e10d1-3d0a-42d7-9195-b96b8daf6f90 tempest-ProjectReaderTests-597601906 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:51 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f09e10d1-3d0a-42d7-9195-b96b8daf6f90 tempest-ProjectReaderTests-597601906 None] Deleted volume successfully. Nov 02 10:59:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f09e10d1-3d0a-42d7-9195-b96b8daf6f90 tempest-ProjectReaderTests-597601906 None] Lock "cinder-6a539b0f-9c38-4fbe-b0cb-f0ac12ab786a-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-fd57a68b-bb74-4e59-964a-0c4125a82b4e-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-fd57a68b-bb74-4e59-964a-0c4125a82b4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-4a366856-2342-4e29-b566-243eb556cb8e" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-4a366856-2342-4e29-b566-243eb556cb8e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-fd57a68b-bb74-4e59-964a-0c4125a82b4e" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-fd57a68b-bb74-4e59-964a-0c4125a82b4e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] Deleting offline snapshot fd57a68b-bb74-4e59-964a-0c4125a82b4e of volume 4a366856-2342-4e29-b566-243eb556cb8e {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:59:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] snapshot_file for this snap is: volume-4a366856-2342-4e29-b566-243eb556cb8e.fd57a68b-bb74-4e59-964a-0c4125a82b4e {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:59:51 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd71c4cc-4ae6-4c99-98b2-bcc0d4477156]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.fd57a68b-bb74-4e59-964a-0c4125a82b4e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:51 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.fd57a68b-bb74-4e59-964a-0c4125a82b4e Nov 02 10:59:51 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:52 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.fd57a68b-bb74-4e59-964a-0c4125a82b4e" returned: 0 in 0.428s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a366856-2342-4e29-b566-243eb556cb8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f229f33a-b4ff-4acb-bdb2-d696a163d745]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:52 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e Nov 02 10:59:52 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:52 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Flow 'volume_create_manager' (d32855cb-ee3b-422f-a178-5d18e3ea5751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f578bde-0925-4d8c-9c66-242bf240cd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e" returned: 0 in 0.568s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.fd57a68b-bb74-4e59-964a-0c4125a82b4e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f578bde-0925-4d8c-9c66-242bf240cd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-46039287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9722d9-f0cd-4130-9b95-011df1f6df1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8afed4a85cad405da31d9ce6ee12914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:53Z,use_quota=True,user_id='9eb9e1e32bee4b2d9fb7786b3e8622f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58191db7-886e-4bc2-99ff-297ba783d7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:52 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.fd57a68b-bb74-4e59-964a-0c4125a82b4e Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58191db7-886e-4bc2-99ff-297ba783d7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:52 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475c01a8-d21d-4867-96e4-7be77d7eca1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475c01a8-d21d-4867-96e4-7be77d7eca1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b9722d9-f0cd-4130-9b95-011df1f6df1c', 'volume_name': 'volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e0b87f-4a0e-4d7e-8de9-3ee302f4e3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e0b87f-4a0e-4d7e-8de9-3ee302f4e3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d42a956-bcda-4192-bb5b-4c75bd95cca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:52 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Volume 3b9722d9-f0cd-4130-9b95-011df1f6df1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c', 'volume_size': 1} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-46039287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9722d9-f0cd-4130-9b95-011df1f6df1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8afed4a85cad405da31d9ce6ee12914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:53Z,use_quota=True,user_id='9eb9e1e32bee4b2d9fb7786b3e8622f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Creating volume 3b9722d9-f0cd-4130-9b95-011df1f6df1c {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:59:52 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:59:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:52 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c 1073741824 Nov 02 10:59:52 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:53 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.fd57a68b-bb74-4e59-964a-0c4125a82b4e" returned: 0 in 0.464s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.fd57a68b-bb74-4e59-964a-0c4125a82b4e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:53 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:59:53 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:53 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.fd57a68b-bb74-4e59-964a-0c4125a82b4e Nov 02 10:59:53 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:53 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c 1073741824" returned: 0 in 0.618s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:53 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.381s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:53 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:59:53 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:59:53 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e.fd57a68b-bb74-4e59-964a-0c4125a82b4e" returned: 0 in 0.400s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-fd57a68b-bb74-4e59-964a-0c4125a82b4e" released by "_delete_snapshot" :: held 2.014s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-4a366856-2342-4e29-b566-243eb556cb8e" released by "delete_snapshot" :: held 2.038s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] Created reservations ['4487882b-730b-4a6e-bf30-4d9e64074b56', '9a926ee8-d5b5-4eee-b85b-6550596ebd85', '48ae5b3e-237f-44cd-86a3-f43aa1e9c622', '52ee0a54-c81a-49d6-a283-6213a3e7e2aa'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:53 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c" returned: 0 in 0.350s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d42a956-bcda-4192-bb5b-4c75bd95cca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d1062c-7b8b-48bd-9de0-b27d9f8dbb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:53 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] Delete snapshot completed successfully. Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1749755e-345b-467d-9cf2-d9ded642fb19 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-fd57a68b-bb74-4e59-964a-0c4125a82b4e-delete_snapshot" released by "delete_snapshot" :: held 2.318s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:53 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Volume volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c (3b9722d9-f0cd-4130-9b95-011df1f6df1c): created successfully Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d1062c-7b8b-48bd-9de0-b27d9f8dbb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Flow 'volume_create_manager' (d32855cb-ee3b-422f-a178-5d18e3ea5751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:53 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c8dd738f-0116-439e-b474-f9d6b60fbf8d tempest-ProjectReaderTests-597601906 None] Created volume successfully. Nov 02 10:59:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-259af011-2dc7-451c-975f-502d5dcc3178 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-4a366856-2342-4e29-b566-243eb556cb8e-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-259af011-2dc7-451c-975f-502d5dcc3178 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-4a366856-2342-4e29-b566-243eb556cb8e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-259af011-2dc7-451c-975f-502d5dcc3178 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-4a366856-2342-4e29-b566-243eb556cb8e" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-259af011-2dc7-451c-975f-502d5dcc3178 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-4a366856-2342-4e29-b566-243eb556cb8e" acquired by "delete_volume" :: waited 0.036s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:54 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[145a3db4-2c23-43b6-8ecc-9a4932b43758]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-259af011-2dc7-451c-975f-502d5dcc3178 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-09fa49a5-a31f-44cc-b70e-b30a94fc0ba5 tempest-ProjectReaderTests-597601906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-09fa49a5-a31f-44cc-b70e-b30a94fc0ba5 tempest-ProjectReaderTests-597601906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-09fa49a5-a31f-44cc-b70e-b30a94fc0ba5 tempest-ProjectReaderTests-597601906 None] Creating offline snapshot 8c5ae6fd-2d17-4f49-8756-2f6722d23f0c of volume 3b9722d9-f0cd-4130-9b95-011df1f6df1c {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:59:55 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d16fce-fd09-403d-8192-b840f0c84ce0]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-09fa49a5-a31f-44cc-b70e-b30a94fc0ba5 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:55 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e Nov 02 10:59:55 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:55 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c Nov 02 10:59:55 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:55 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-259af011-2dc7-451c-975f-502d5dcc3178 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e" returned: 0 in 0.407s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-259af011-2dc7-451c-975f-502d5dcc3178 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:55 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e Nov 02 10:59:55 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:55 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-09fa49a5-a31f-44cc-b70e-b30a94fc0ba5 tempest-ProjectReaderTests-597601906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c" returned: 0 in 0.458s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-09fa49a5-a31f-44cc-b70e-b30a94fc0ba5 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.8c5ae6fd-2d17-4f49-8756-2f6722d23f0c 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:55 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.8c5ae6fd-2d17-4f49-8756-2f6722d23f0c 1G Nov 02 10:59:55 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:55 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-259af011-2dc7-451c-975f-502d5dcc3178 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-4a366856-2342-4e29-b566-243eb556cb8e" returned: 0 in 0.295s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-259af011-2dc7-451c-975f-502d5dcc3178 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-4a366856-2342-4e29-b566-243eb556cb8e" released by "delete_volume" :: held 0.813s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:55 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-259af011-2dc7-451c-975f-502d5dcc3178 tempest-ProjectMemberTests-1266221133 None] Created reservations ['5cdc660b-5c84-4266-a096-5372965da5d8', '84095709-5b64-4026-af48-77b3cd11ec17', '419fca46-0663-4045-8151-01f9888a9824', '3f426056-5ba8-458e-8af1-76d94ad22ee2'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-259af011-2dc7-451c-975f-502d5dcc3178 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-259af011-2dc7-451c-975f-502d5dcc3178 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-259af011-2dc7-451c-975f-502d5dcc3178 tempest-ProjectMemberTests-1266221133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-259af011-2dc7-451c-975f-502d5dcc3178 tempest-ProjectMemberTests-1266221133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-259af011-2dc7-451c-975f-502d5dcc3178 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-259af011-2dc7-451c-975f-502d5dcc3178 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:55 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 10:59:55 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:56 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-09fa49a5-a31f-44cc-b70e-b30a94fc0ba5 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.8c5ae6fd-2d17-4f49-8756-2f6722d23f0c 1G" returned: 0 in 0.606s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-09fa49a5-a31f-44cc-b70e-b30a94fc0ba5 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.8c5ae6fd-2d17-4f49-8756-2f6722d23f0c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:56 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.8c5ae6fd-2d17-4f49-8756-2f6722d23f0c Nov 02 10:59:56 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:56 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-259af011-2dc7-451c-975f-502d5dcc3178 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.442s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-259af011-2dc7-451c-975f-502d5dcc3178 tempest-ProjectMemberTests-1266221133 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:56 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-259af011-2dc7-451c-975f-502d5dcc3178 tempest-ProjectMemberTests-1266221133 None] Deleted volume successfully. Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-259af011-2dc7-451c-975f-502d5dcc3178 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-4a366856-2342-4e29-b566-243eb556cb8e-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:56 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-09fa49a5-a31f-44cc-b70e-b30a94fc0ba5 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.8c5ae6fd-2d17-4f49-8756-2f6722d23f0c" returned: 0 in 0.384s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:56 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-09fa49a5-a31f-44cc-b70e-b30a94fc0ba5 tempest-ProjectReaderTests-597601906 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.8c5ae6fd-2d17-4f49-8756-2f6722d23f0c is being set with open permissions: ugo+rw Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-09fa49a5-a31f-44cc-b70e-b30a94fc0ba5 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.8c5ae6fd-2d17-4f49-8756-2f6722d23f0c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:56 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.8c5ae6fd-2d17-4f49-8756-2f6722d23f0c Nov 02 10:59:56 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Flow 'volume_create_manager' (4aae48ac-03db-47e5-bd92-492671798f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f5fc2e-edbf-427b-84e6-3bd423a398f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f5fc2e-edbf-427b-84e6-3bd423a398f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-242668665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8808b829-3a51-430a-be90-13ecf201ed79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de43071a1c4348bf85c649c8f77ffcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:57Z,use_quota=True,user_id='eeeb85b0d7c743069682afbcc7ffccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aaa84d5-fb70-4ab7-82ff-837d5ef3597f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aaa84d5-fb70-4ab7-82ff-837d5ef3597f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2137bdf-39d0-405e-9d0c-03d27a8f36bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2137bdf-39d0-405e-9d0c-03d27a8f36bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8808b829-3a51-430a-be90-13ecf201ed79', 'volume_name': 'volume-8808b829-3a51-430a-be90-13ecf201ed79', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b59f2226-9f14-4f5a-bf37-40b637ec299e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b59f2226-9f14-4f5a-bf37-40b637ec299e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e9f4e5-589b-4630-b5ee-6b9bf74b22db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:56 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Volume 8808b829-3a51-430a-be90-13ecf201ed79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8808b829-3a51-430a-be90-13ecf201ed79', 'volume_size': 1} Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:56 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-09fa49a5-a31f-44cc-b70e-b30a94fc0ba5 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.8c5ae6fd-2d17-4f49-8756-2f6722d23f0c" returned: 0 in 0.285s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-09fa49a5-a31f-44cc-b70e-b30a94fc0ba5 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:56 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.info Nov 02 10:59:56 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:57 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-09fa49a5-a31f-44cc-b70e-b30a94fc0ba5 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.info" returned: 0 in 0.252s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:57 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-09fa49a5-a31f-44cc-b70e-b30a94fc0ba5 tempest-ProjectReaderTests-597601906 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.info is being set with open permissions: ugo+rw Nov 02 10:59:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-09fa49a5-a31f-44cc-b70e-b30a94fc0ba5 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:57 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.info Nov 02 10:59:57 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:57 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-09fa49a5-a31f-44cc-b70e-b30a94fc0ba5 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.info" returned: 0 in 0.254s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-09fa49a5-a31f-44cc-b70e-b30a94fc0ba5 tempest-ProjectReaderTests-597601906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.357s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.680s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-242668665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8808b829-3a51-430a-be90-13ecf201ed79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de43071a1c4348bf85c649c8f77ffcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:57Z,use_quota=True,user_id='eeeb85b0d7c743069682afbcc7ffccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:59:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Creating volume 8808b829-3a51-430a-be90-13ecf201ed79 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:59:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:59:57 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 10:59:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:57 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79 1073741824 Nov 02 10:59:57 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-09fa49a5-a31f-44cc-b70e-b30a94fc0ba5 tempest-ProjectReaderTests-597601906 None] Create snapshot completed successfully Nov 02 10:59:57 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79 1073741824" returned: 0 in 0.487s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:57 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79 Nov 02 10:59:57 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-8c5ae6fd-2d17-4f49-8756-2f6722d23f0c-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:58 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79" returned: 0 in 0.260s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] Lock "cinder-8c5ae6fd-2d17-4f49-8756-2f6722d23f0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-quobyte-3b9722d9-f0cd-4130-9b95-011df1f6df1c" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e9f4e5-589b-4630-b5ee-6b9bf74b22db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8808b829-3a51-430a-be90-13ecf201ed79', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bbfa402-c7a6-4c35-8b4a-88303ddf84e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-3b9722d9-f0cd-4130-9b95-011df1f6df1c" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-quobyte-8c5ae6fd-2d17-4f49-8756-2f6722d23f0c" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:58 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Volume volume-8808b829-3a51-430a-be90-13ecf201ed79 (8808b829-3a51-430a-be90-13ecf201ed79): created successfully Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bbfa402-c7a6-4c35-8b4a-88303ddf84e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Flow 'volume_create_manager' (4aae48ac-03db-47e5-bd92-492671798f16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-8c5ae6fd-2d17-4f49-8756-2f6722d23f0c" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] Deleting offline snapshot 8c5ae6fd-2d17-4f49-8756-2f6722d23f0c of volume 3b9722d9-f0cd-4130-9b95-011df1f6df1c {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] snapshot_file for this snap is: volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.8c5ae6fd-2d17-4f49-8756-2f6722d23f0c {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:59:58 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3b9e6a62-e78a-4e03-b1a3-de2a88cf5e96 tempest-ProjectMemberTests-1266221133 None] Created volume successfully. Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c508dd-c9a0-407a-9564-ea7588968d02]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.8c5ae6fd-2d17-4f49-8756-2f6722d23f0c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:58 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.8c5ae6fd-2d17-4f49-8756-2f6722d23f0c Nov 02 10:59:58 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:58 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.8c5ae6fd-2d17-4f49-8756-2f6722d23f0c" returned: 0 in 0.409s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75a7d99-c675-41d8-84e3-eaf1041675d3]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5018d159-73a3-4d89-b118-a6a19019fd25 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5018d159-73a3-4d89-b118-a6a19019fd25 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5018d159-73a3-4d89-b118-a6a19019fd25 tempest-ProjectMemberTests-1266221133 None] Creating offline snapshot ee7ba942-1bae-4375-b327-53fd5b54f3f1 of volume 8808b829-3a51-430a-be90-13ecf201ed79 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f426eaa3-f28b-4e1f-88c2-dc9779d605a1]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5018d159-73a3-4d89-b118-a6a19019fd25 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:58 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c Nov 02 10:59:58 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:59 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79 Nov 02 10:59:59 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:59 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c" returned: 0 in 0.445s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.8c5ae6fd-2d17-4f49-8756-2f6722d23f0c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:59 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.8c5ae6fd-2d17-4f49-8756-2f6722d23f0c Nov 02 10:59:59 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:59 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5018d159-73a3-4d89-b118-a6a19019fd25 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79" returned: 0 in 0.420s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5018d159-73a3-4d89-b118-a6a19019fd25 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.ee7ba942-1bae-4375-b327-53fd5b54f3f1 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:59 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.ee7ba942-1bae-4375-b327-53fd5b54f3f1 1G Nov 02 10:59:59 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:59 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.8c5ae6fd-2d17-4f49-8756-2f6722d23f0c" returned: 0 in 0.411s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.8c5ae6fd-2d17-4f49-8756-2f6722d23f0c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:59 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.8c5ae6fd-2d17-4f49-8756-2f6722d23f0c Nov 02 10:59:59 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:59 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5018d159-73a3-4d89-b118-a6a19019fd25 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.ee7ba942-1bae-4375-b327-53fd5b54f3f1 1G" returned: 0 in 0.476s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5018d159-73a3-4d89-b118-a6a19019fd25 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8808b829-3a51-430a-be90-13ecf201ed79 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.ee7ba942-1bae-4375-b327-53fd5b54f3f1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:59 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8808b829-3a51-430a-be90-13ecf201ed79 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.ee7ba942-1bae-4375-b327-53fd5b54f3f1 Nov 02 10:59:59 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:59 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c.8c5ae6fd-2d17-4f49-8756-2f6722d23f0c" returned: 0 in 0.273s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-8c5ae6fd-2d17-4f49-8756-2f6722d23f0c" released by "_delete_snapshot" :: held 1.689s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-3b9722d9-f0cd-4130-9b95-011df1f6df1c" released by "delete_snapshot" :: held 1.731s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:00 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] Created reservations ['6ce635ee-3cd5-4961-a471-d00387b65ea6', '433896eb-3e4f-4645-bfd6-7a8854fbc396', '2ac9da66-4bc3-4dab-9e29-fe3e97b8cba3', 'cb5dda4c-1b72-4448-8977-145ed06dcc7a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:00 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] Delete snapshot completed successfully. Nov 02 11:00:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-81295b96-2d42-4eea-a3a9-98173cd37b40 tempest-ProjectReaderTests-597601906 None] Lock "cinder-8c5ae6fd-2d17-4f49-8756-2f6722d23f0c-delete_snapshot" released by "delete_snapshot" :: held 1.908s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:00 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5018d159-73a3-4d89-b118-a6a19019fd25 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8808b829-3a51-430a-be90-13ecf201ed79 -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.ee7ba942-1bae-4375-b327-53fd5b54f3f1" returned: 0 in 0.354s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:00 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-5018d159-73a3-4d89-b118-a6a19019fd25 tempest-ProjectMemberTests-1266221133 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.ee7ba942-1bae-4375-b327-53fd5b54f3f1 is being set with open permissions: ugo+rw Nov 02 11:00:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5018d159-73a3-4d89-b118-a6a19019fd25 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.ee7ba942-1bae-4375-b327-53fd5b54f3f1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:00 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.ee7ba942-1bae-4375-b327-53fd5b54f3f1 Nov 02 11:00:00 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2f3ed53f-e790-4ab7-9e0c-86ab9231e4ff tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-3b9722d9-f0cd-4130-9b95-011df1f6df1c-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2f3ed53f-e790-4ab7-9e0c-86ab9231e4ff tempest-ProjectReaderTests-597601906 None] Lock "cinder-3b9722d9-f0cd-4130-9b95-011df1f6df1c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2f3ed53f-e790-4ab7-9e0c-86ab9231e4ff tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-quobyte-3b9722d9-f0cd-4130-9b95-011df1f6df1c" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2f3ed53f-e790-4ab7-9e0c-86ab9231e4ff tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-3b9722d9-f0cd-4130-9b95-011df1f6df1c" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:00 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5018d159-73a3-4d89-b118-a6a19019fd25 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.ee7ba942-1bae-4375-b327-53fd5b54f3f1" returned: 0 in 0.311s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:00 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b44697f-7d3e-4362-b270-41257c480c3c]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2f3ed53f-e790-4ab7-9e0c-86ab9231e4ff tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5018d159-73a3-4d89-b118-a6a19019fd25 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:00 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.info Nov 02 11:00:00 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:00 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c Nov 02 11:00:00 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:00 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5018d159-73a3-4d89-b118-a6a19019fd25 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.info" returned: 0 in 0.279s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:00 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-5018d159-73a3-4d89-b118-a6a19019fd25 tempest-ProjectMemberTests-1266221133 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.info is being set with open permissions: ugo+rw Nov 02 11:00:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5018d159-73a3-4d89-b118-a6a19019fd25 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:00 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.info Nov 02 11:00:00 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:00 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2f3ed53f-e790-4ab7-9e0c-86ab9231e4ff tempest-ProjectReaderTests-597601906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c" returned: 0 in 0.479s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2f3ed53f-e790-4ab7-9e0c-86ab9231e4ff tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:00 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c Nov 02 11:00:00 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:01 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5018d159-73a3-4d89-b118-a6a19019fd25 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.info" returned: 0 in 0.348s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5018d159-73a3-4d89-b118-a6a19019fd25 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.300s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:01 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5018d159-73a3-4d89-b118-a6a19019fd25 tempest-ProjectMemberTests-1266221133 None] Create snapshot completed successfully Nov 02 11:00:01 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2f3ed53f-e790-4ab7-9e0c-86ab9231e4ff tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-3b9722d9-f0cd-4130-9b95-011df1f6df1c" returned: 0 in 0.297s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2f3ed53f-e790-4ab7-9e0c-86ab9231e4ff tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-3b9722d9-f0cd-4130-9b95-011df1f6df1c" released by "delete_volume" :: held 0.864s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:01 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-2f3ed53f-e790-4ab7-9e0c-86ab9231e4ff tempest-ProjectReaderTests-597601906 None] Created reservations ['087c3971-ac2b-4a7c-b8d2-9d860e0944ea', 'ae3b9b45-2887-4f04-af88-e1b0bd122ad2', '94b1559d-f3c3-4e25-876d-1a3d1f1affd4', '108485f7-3e9a-4977-90ae-c0c18187ed36'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2f3ed53f-e790-4ab7-9e0c-86ab9231e4ff tempest-ProjectReaderTests-597601906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2f3ed53f-e790-4ab7-9e0c-86ab9231e4ff tempest-ProjectReaderTests-597601906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2f3ed53f-e790-4ab7-9e0c-86ab9231e4ff tempest-ProjectReaderTests-597601906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2f3ed53f-e790-4ab7-9e0c-86ab9231e4ff tempest-ProjectReaderTests-597601906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2f3ed53f-e790-4ab7-9e0c-86ab9231e4ff tempest-ProjectReaderTests-597601906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2f3ed53f-e790-4ab7-9e0c-86ab9231e4ff tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:01 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 11:00:01 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:01 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2f3ed53f-e790-4ab7-9e0c-86ab9231e4ff tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.267s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:01 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-2f3ed53f-e790-4ab7-9e0c-86ab9231e4ff tempest-ProjectReaderTests-597601906 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:01 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2f3ed53f-e790-4ab7-9e0c-86ab9231e4ff tempest-ProjectReaderTests-597601906 None] Deleted volume successfully. Nov 02 11:00:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2f3ed53f-e790-4ab7-9e0c-86ab9231e4ff tempest-ProjectReaderTests-597601906 None] Lock "cinder-3b9722d9-f0cd-4130-9b95-011df1f6df1c-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Flow 'volume_create_manager' (561368e0-a604-4118-a441-e25672d1362a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b3dcc32-cfcb-4c11-9df4-6d0b39d5c2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-ee7ba942-1bae-4375-b327-53fd5b54f3f1-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b3dcc32-cfcb-4c11-9df4-6d0b39d5c2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1246467688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18cc5b6d-6bef-42c5-a06e-19ba051b66ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8afed4a85cad405da31d9ce6ee12914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:02Z,use_quota=True,user_id='9eb9e1e32bee4b2d9fb7786b3e8622f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922903a3-4e55-4c49-9f8f-01ab7747aebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922903a3-4e55-4c49-9f8f-01ab7747aebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0224a1b-6452-41df-8049-ab4e89a0bb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0224a1b-6452-41df-8049-ab4e89a0bb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18cc5b6d-6bef-42c5-a06e-19ba051b66ba', 'volume_name': 'volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5545b0-299e-4fbb-8663-3b64dd8a10e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5545b0-299e-4fbb-8663-3b64dd8a10e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4e7285-eeb8-4da6-aea0-ad8fef21c16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:02 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Volume 18cc5b6d-6bef-42c5-a06e-19ba051b66ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba', 'volume_size': 1} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1246467688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18cc5b6d-6bef-42c5-a06e-19ba051b66ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8afed4a85cad405da31d9ce6ee12914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:02Z,use_quota=True,user_id='9eb9e1e32bee4b2d9fb7786b3e8622f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Creating volume 18cc5b6d-6bef-42c5-a06e-19ba051b66ba {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:00:02 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-ee7ba942-1bae-4375-b327-53fd5b54f3f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.086s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-8808b829-3a51-430a-be90-13ecf201ed79" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:02 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba 1073741824 Nov 02 11:00:02 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-8808b829-3a51-430a-be90-13ecf201ed79" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-ee7ba942-1bae-4375-b327-53fd5b54f3f1" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-ee7ba942-1bae-4375-b327-53fd5b54f3f1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] Deleting offline snapshot ee7ba942-1bae-4375-b327-53fd5b54f3f1 of volume 8808b829-3a51-430a-be90-13ecf201ed79 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] snapshot_file for this snap is: volume-8808b829-3a51-430a-be90-13ecf201ed79.ee7ba942-1bae-4375-b327-53fd5b54f3f1 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fc28cc-17ff-4f11-8dff-bb2ec95b6d3c]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.ee7ba942-1bae-4375-b327-53fd5b54f3f1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:02 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.ee7ba942-1bae-4375-b327-53fd5b54f3f1 Nov 02 11:00:02 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:02 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.ee7ba942-1bae-4375-b327-53fd5b54f3f1" returned: 0 in 0.399s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8808b829-3a51-430a-be90-13ecf201ed79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:00:02 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba 1073741824" returned: 0 in 0.526s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c628b5-5389-48bc-9a10-3f68557246e8]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:02 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba Nov 02 11:00:02 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:02 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79 Nov 02 11:00:02 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:02 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba" returned: 0 in 0.291s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:00:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4e7285-eeb8-4da6-aea0-ad8fef21c16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e71adac3-74ee-4e85-b422-8ebfca1e927b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:03 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Volume volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba (18cc5b6d-6bef-42c5-a06e-19ba051b66ba): created successfully Nov 02 11:00:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e71adac3-74ee-4e85-b422-8ebfca1e927b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Flow 'volume_create_manager' (561368e0-a604-4118-a441-e25672d1362a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-add19ccd-c4fc-4cf5-92b1-9deef5f1f6f8 tempest-ProjectReaderTests-597601906 None] Created volume successfully. Nov 02 11:00:03 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79" returned: 0 in 0.413s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.ee7ba942-1bae-4375-b327-53fd5b54f3f1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:03 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.ee7ba942-1bae-4375-b327-53fd5b54f3f1 Nov 02 11:00:03 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:03 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.ee7ba942-1bae-4375-b327-53fd5b54f3f1" returned: 0 in 0.327s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.ee7ba942-1bae-4375-b327-53fd5b54f3f1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:03 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.ee7ba942-1bae-4375-b327-53fd5b54f3f1 Nov 02 11:00:03 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:03 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79.ee7ba942-1bae-4375-b327-53fd5b54f3f1" returned: 0 in 0.246s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-ee7ba942-1bae-4375-b327-53fd5b54f3f1" released by "_delete_snapshot" :: held 1.508s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-8808b829-3a51-430a-be90-13ecf201ed79" released by "delete_snapshot" :: held 1.532s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:03 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] Created reservations ['662c6a21-8d84-4cf9-b8d3-0abf15edb1cc', '74e3d6f7-c4c9-4d48-b551-b5649122f412', '0c2f5b08-4a8f-4f8d-915e-ee1a6ab963af', 'bc89003e-9a67-4f56-bfec-43a717248a52'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] Delete snapshot completed successfully. Nov 02 11:00:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c35c99f8-bc32-4eca-beca-3bf66bdcfc56 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-ee7ba942-1bae-4375-b327-53fd5b54f3f1-delete_snapshot" released by "delete_snapshot" :: held 1.662s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4f92d80f-2b15-4886-bc2f-db1a70ac3983 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-8808b829-3a51-430a-be90-13ecf201ed79-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4f92d80f-2b15-4886-bc2f-db1a70ac3983 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-8808b829-3a51-430a-be90-13ecf201ed79-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-279c06ef-e5c7-424d-be01-ec0110c6bcf1 tempest-ProjectReaderTests-597601906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-279c06ef-e5c7-424d-be01-ec0110c6bcf1 tempest-ProjectReaderTests-597601906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-279c06ef-e5c7-424d-be01-ec0110c6bcf1 tempest-ProjectReaderTests-597601906 None] Creating offline snapshot 42c9c54b-2f99-4625-9525-ca63a81aa405 of volume 18cc5b6d-6bef-42c5-a06e-19ba051b66ba {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:00:04 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3124d876-e0df-4656-8b52-e10face8ad3d]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-279c06ef-e5c7-424d-be01-ec0110c6bcf1 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4f92d80f-2b15-4886-bc2f-db1a70ac3983 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-8808b829-3a51-430a-be90-13ecf201ed79" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4f92d80f-2b15-4886-bc2f-db1a70ac3983 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-8808b829-3a51-430a-be90-13ecf201ed79" acquired by "delete_volume" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:04 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4456b9-8561-436d-8dea-7462b819c353]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4f92d80f-2b15-4886-bc2f-db1a70ac3983 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:04 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba Nov 02 11:00:04 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:04 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79 Nov 02 11:00:04 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:04 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-279c06ef-e5c7-424d-be01-ec0110c6bcf1 tempest-ProjectReaderTests-597601906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba" returned: 0 in 0.366s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-279c06ef-e5c7-424d-be01-ec0110c6bcf1 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.42c9c54b-2f99-4625-9525-ca63a81aa405 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:04 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.42c9c54b-2f99-4625-9525-ca63a81aa405 1G Nov 02 11:00:04 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:04 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4f92d80f-2b15-4886-bc2f-db1a70ac3983 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79" returned: 0 in 0.371s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4f92d80f-2b15-4886-bc2f-db1a70ac3983 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:04 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79 Nov 02 11:00:04 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:04 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4f92d80f-2b15-4886-bc2f-db1a70ac3983 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8808b829-3a51-430a-be90-13ecf201ed79" returned: 0 in 0.272s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4f92d80f-2b15-4886-bc2f-db1a70ac3983 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-8808b829-3a51-430a-be90-13ecf201ed79" released by "delete_volume" :: held 0.705s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:05 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-279c06ef-e5c7-424d-be01-ec0110c6bcf1 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.42c9c54b-2f99-4625-9525-ca63a81aa405 1G" returned: 0 in 0.415s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-279c06ef-e5c7-424d-be01-ec0110c6bcf1 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.42c9c54b-2f99-4625-9525-ca63a81aa405 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-4f92d80f-2b15-4886-bc2f-db1a70ac3983 tempest-ProjectMemberTests-1266221133 None] Created reservations ['ae2ff236-f5c3-40de-a53d-735806999c31', '20ad40c4-ae53-4464-9267-408eb7c32b5f', 'f558815b-bd33-4617-abb4-0abd96662cd3', '88468850-be86-4a5f-8459-65b421902128'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:05 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.42c9c54b-2f99-4625-9525-ca63a81aa405 Nov 02 11:00:05 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4f92d80f-2b15-4886-bc2f-db1a70ac3983 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4f92d80f-2b15-4886-bc2f-db1a70ac3983 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4f92d80f-2b15-4886-bc2f-db1a70ac3983 tempest-ProjectMemberTests-1266221133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4f92d80f-2b15-4886-bc2f-db1a70ac3983 tempest-ProjectMemberTests-1266221133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4f92d80f-2b15-4886-bc2f-db1a70ac3983 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4f92d80f-2b15-4886-bc2f-db1a70ac3983 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:05 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 11:00:05 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:05 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-279c06ef-e5c7-424d-be01-ec0110c6bcf1 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.42c9c54b-2f99-4625-9525-ca63a81aa405" returned: 0 in 0.304s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:05 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-279c06ef-e5c7-424d-be01-ec0110c6bcf1 tempest-ProjectReaderTests-597601906 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.42c9c54b-2f99-4625-9525-ca63a81aa405 is being set with open permissions: ugo+rw Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-279c06ef-e5c7-424d-be01-ec0110c6bcf1 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.42c9c54b-2f99-4625-9525-ca63a81aa405 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:05 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.42c9c54b-2f99-4625-9525-ca63a81aa405 Nov 02 11:00:05 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:05 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4f92d80f-2b15-4886-bc2f-db1a70ac3983 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.267s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-4f92d80f-2b15-4886-bc2f-db1a70ac3983 tempest-ProjectMemberTests-1266221133 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:05 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4f92d80f-2b15-4886-bc2f-db1a70ac3983 tempest-ProjectMemberTests-1266221133 None] Deleted volume successfully. Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4f92d80f-2b15-4886-bc2f-db1a70ac3983 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-8808b829-3a51-430a-be90-13ecf201ed79-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:05 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-279c06ef-e5c7-424d-be01-ec0110c6bcf1 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.42c9c54b-2f99-4625-9525-ca63a81aa405" returned: 0 in 0.249s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-279c06ef-e5c7-424d-be01-ec0110c6bcf1 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:05 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.info Nov 02 11:00:05 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Flow 'volume_create_manager' (182f96c9-80f2-4870-bd12-2b0ea6ee8834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b516b4e-f074-490e-99bf-96abfa2e049c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b516b4e-f074-490e-99bf-96abfa2e049c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1308306700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be068e22-b196-4f34-8252-22d9423714ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de43071a1c4348bf85c649c8f77ffcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:06Z,use_quota=True,user_id='eeeb85b0d7c743069682afbcc7ffccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb01de7-bfbe-4e68-8fe0-d791ca995885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb01de7-bfbe-4e68-8fe0-d791ca995885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde8933e-0c78-4cc0-9759-be15a5bdb28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde8933e-0c78-4cc0-9759-be15a5bdb28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be068e22-b196-4f34-8252-22d9423714ba', 'volume_name': 'volume-be068e22-b196-4f34-8252-22d9423714ba', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e52aea3-1be7-4481-8d86-41779c6c4a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e52aea3-1be7-4481-8d86-41779c6c4a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73a6d84-1502-46d6-a23b-2a05d2aa81af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:05 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Volume be068e22-b196-4f34-8252-22d9423714ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be068e22-b196-4f34-8252-22d9423714ba', 'volume_size': 1} Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:05 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-279c06ef-e5c7-424d-be01-ec0110c6bcf1 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.info" returned: 0 in 0.276s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:05 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-279c06ef-e5c7-424d-be01-ec0110c6bcf1 tempest-ProjectReaderTests-597601906 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.info is being set with open permissions: ugo+rw Nov 02 11:00:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-279c06ef-e5c7-424d-be01-ec0110c6bcf1 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:05 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.info Nov 02 11:00:05 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:06 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-279c06ef-e5c7-424d-be01-ec0110c6bcf1 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.info" returned: 0 in 0.247s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-279c06ef-e5c7-424d-be01-ec0110c6bcf1 tempest-ProjectReaderTests-597601906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.950s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.274s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1308306700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be068e22-b196-4f34-8252-22d9423714ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de43071a1c4348bf85c649c8f77ffcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:06Z,use_quota=True,user_id='eeeb85b0d7c743069682afbcc7ffccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Creating volume be068e22-b196-4f34-8252-22d9423714ba {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:00:06 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:06 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba 1073741824 Nov 02 11:00:06 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:06 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-279c06ef-e5c7-424d-be01-ec0110c6bcf1 tempest-ProjectReaderTests-597601906 None] Create snapshot completed successfully Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-42c9c54b-2f99-4625-9525-ca63a81aa405-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] Lock "cinder-42c9c54b-2f99-4625-9525-ca63a81aa405-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-quobyte-18cc5b6d-6bef-42c5-a06e-19ba051b66ba" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-18cc5b6d-6bef-42c5-a06e-19ba051b66ba" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-quobyte-42c9c54b-2f99-4625-9525-ca63a81aa405" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-42c9c54b-2f99-4625-9525-ca63a81aa405" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] Deleting offline snapshot 42c9c54b-2f99-4625-9525-ca63a81aa405 of volume 18cc5b6d-6bef-42c5-a06e-19ba051b66ba {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] snapshot_file for this snap is: volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.42c9c54b-2f99-4625-9525-ca63a81aa405 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[191c90c0-e0db-4103-938d-a58cb4838597]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.42c9c54b-2f99-4625-9525-ca63a81aa405 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:06 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.42c9c54b-2f99-4625-9525-ca63a81aa405 Nov 02 11:00:06 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:06 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba 1073741824" returned: 0 in 0.441s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:06 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba Nov 02 11:00:06 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:06 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.42c9c54b-2f99-4625-9525-ca63a81aa405" returned: 0 in 0.386s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[448564ae-cbfa-477c-9abf-7c3e79c0b102]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:06 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba" returned: 0 in 0.258s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73a6d84-1502-46d6-a23b-2a05d2aa81af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be068e22-b196-4f34-8252-22d9423714ba', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26bac663-dfaf-441c-b9d3-a0adea7a5955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:06 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Volume volume-be068e22-b196-4f34-8252-22d9423714ba (be068e22-b196-4f34-8252-22d9423714ba): created successfully Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26bac663-dfaf-441c-b9d3-a0adea7a5955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Flow 'volume_create_manager' (182f96c9-80f2-4870-bd12-2b0ea6ee8834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:06 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8bb5289a-b76c-4f56-86c7-d7931db338f3 tempest-ProjectMemberTests-1266221133 None] Created volume successfully. Nov 02 11:00:06 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba Nov 02 11:00:06 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:07 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba" returned: 0 in 0.362s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.42c9c54b-2f99-4625-9525-ca63a81aa405 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:07 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.42c9c54b-2f99-4625-9525-ca63a81aa405 Nov 02 11:00:07 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:07 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.42c9c54b-2f99-4625-9525-ca63a81aa405" returned: 0 in 0.328s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.42c9c54b-2f99-4625-9525-ca63a81aa405 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:07 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.42c9c54b-2f99-4625-9525-ca63a81aa405 Nov 02 11:00:07 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:07 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba.42c9c54b-2f99-4625-9525-ca63a81aa405" returned: 0 in 0.262s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-42c9c54b-2f99-4625-9525-ca63a81aa405" released by "_delete_snapshot" :: held 1.451s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-18cc5b6d-6bef-42c5-a06e-19ba051b66ba" released by "delete_snapshot" :: held 1.474s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:07 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] Created reservations ['4b4f73bb-882b-4d8e-8d25-9dc2cef2d0fd', '3a5fa96a-5181-44a0-8bc4-e21fe59fe8d9', 'e373195b-51f0-4f1e-818f-015663d7823f', '529222a3-3608-4e85-8e23-e3a63b353a6a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:07 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] Delete snapshot completed successfully. Nov 02 11:00:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7d13cf18-7d61-45a5-9cd3-1eddf226771e tempest-ProjectReaderTests-597601906 None] Lock "cinder-42c9c54b-2f99-4625-9525-ca63a81aa405-delete_snapshot" released by "delete_snapshot" :: held 1.614s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f73bfea8-5896-41a5-a4d0-b6d68eb66bd1 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f73bfea8-5896-41a5-a4d0-b6d68eb66bd1 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f73bfea8-5896-41a5-a4d0-b6d68eb66bd1 tempest-ProjectMemberTests-1266221133 None] Creating offline snapshot 32c32f99-f217-4887-bc37-01d1d2143a3d of volume be068e22-b196-4f34-8252-22d9423714ba {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:00:08 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8929b3b-b0f8-49d0-a4b1-28bd982e68a6]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f73bfea8-5896-41a5-a4d0-b6d68eb66bd1 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:08 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba Nov 02 11:00:08 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:08 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f73bfea8-5896-41a5-a4d0-b6d68eb66bd1 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba" returned: 0 in 0.373s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f73bfea8-5896-41a5-a4d0-b6d68eb66bd1 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.32c32f99-f217-4887-bc37-01d1d2143a3d 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:08 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.32c32f99-f217-4887-bc37-01d1d2143a3d 1G Nov 02 11:00:08 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e0efddbc-d8ea-4004-a471-f5009d403331 tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-18cc5b6d-6bef-42c5-a06e-19ba051b66ba-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e0efddbc-d8ea-4004-a471-f5009d403331 tempest-ProjectReaderTests-597601906 None] Lock "cinder-18cc5b6d-6bef-42c5-a06e-19ba051b66ba-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e0efddbc-d8ea-4004-a471-f5009d403331 tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-quobyte-18cc5b6d-6bef-42c5-a06e-19ba051b66ba" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e0efddbc-d8ea-4004-a471-f5009d403331 tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-18cc5b6d-6bef-42c5-a06e-19ba051b66ba" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:08 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1301801-5c76-4316-88e4-a2c10072a984]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0efddbc-d8ea-4004-a471-f5009d403331 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:08 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba Nov 02 11:00:08 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:08 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f73bfea8-5896-41a5-a4d0-b6d68eb66bd1 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.32c32f99-f217-4887-bc37-01d1d2143a3d 1G" returned: 0 in 0.464s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f73bfea8-5896-41a5-a4d0-b6d68eb66bd1 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be068e22-b196-4f34-8252-22d9423714ba -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.32c32f99-f217-4887-bc37-01d1d2143a3d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:08 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be068e22-b196-4f34-8252-22d9423714ba -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.32c32f99-f217-4887-bc37-01d1d2143a3d Nov 02 11:00:08 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:09 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0efddbc-d8ea-4004-a471-f5009d403331 tempest-ProjectReaderTests-597601906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba" returned: 0 in 0.403s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0efddbc-d8ea-4004-a471-f5009d403331 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:09 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba Nov 02 11:00:09 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:09 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f73bfea8-5896-41a5-a4d0-b6d68eb66bd1 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be068e22-b196-4f34-8252-22d9423714ba -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.32c32f99-f217-4887-bc37-01d1d2143a3d" returned: 0 in 0.306s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:09 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-f73bfea8-5896-41a5-a4d0-b6d68eb66bd1 tempest-ProjectMemberTests-1266221133 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.32c32f99-f217-4887-bc37-01d1d2143a3d is being set with open permissions: ugo+rw Nov 02 11:00:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f73bfea8-5896-41a5-a4d0-b6d68eb66bd1 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.32c32f99-f217-4887-bc37-01d1d2143a3d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:09 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.32c32f99-f217-4887-bc37-01d1d2143a3d Nov 02 11:00:09 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:09 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0efddbc-d8ea-4004-a471-f5009d403331 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-18cc5b6d-6bef-42c5-a06e-19ba051b66ba" returned: 0 in 0.272s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e0efddbc-d8ea-4004-a471-f5009d403331 tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-18cc5b6d-6bef-42c5-a06e-19ba051b66ba" released by "delete_volume" :: held 0.744s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:09 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-e0efddbc-d8ea-4004-a471-f5009d403331 tempest-ProjectReaderTests-597601906 None] Created reservations ['ce3015bb-0e78-47a3-b295-4178477bbbed', 'fd02615e-4de1-486d-be01-e4a2d2d8e006', 'c3b23031-6e82-40a9-b65a-8f23bd38a19d', '9e8f2ebc-69c7-4da3-be1a-f26af00bf3a2'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e0efddbc-d8ea-4004-a471-f5009d403331 tempest-ProjectReaderTests-597601906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e0efddbc-d8ea-4004-a471-f5009d403331 tempest-ProjectReaderTests-597601906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e0efddbc-d8ea-4004-a471-f5009d403331 tempest-ProjectReaderTests-597601906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e0efddbc-d8ea-4004-a471-f5009d403331 tempest-ProjectReaderTests-597601906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e0efddbc-d8ea-4004-a471-f5009d403331 tempest-ProjectReaderTests-597601906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0efddbc-d8ea-4004-a471-f5009d403331 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:09 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 11:00:09 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:09 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f73bfea8-5896-41a5-a4d0-b6d68eb66bd1 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.32c32f99-f217-4887-bc37-01d1d2143a3d" returned: 0 in 0.258s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f73bfea8-5896-41a5-a4d0-b6d68eb66bd1 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:09 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.info Nov 02 11:00:09 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:09 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0efddbc-d8ea-4004-a471-f5009d403331 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.273s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:09 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-e0efddbc-d8ea-4004-a471-f5009d403331 tempest-ProjectReaderTests-597601906 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:09 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e0efddbc-d8ea-4004-a471-f5009d403331 tempest-ProjectReaderTests-597601906 None] Deleted volume successfully. Nov 02 11:00:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e0efddbc-d8ea-4004-a471-f5009d403331 tempest-ProjectReaderTests-597601906 None] Lock "cinder-18cc5b6d-6bef-42c5-a06e-19ba051b66ba-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:09 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f73bfea8-5896-41a5-a4d0-b6d68eb66bd1 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.info" returned: 0 in 0.281s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:09 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-f73bfea8-5896-41a5-a4d0-b6d68eb66bd1 tempest-ProjectMemberTests-1266221133 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.info is being set with open permissions: ugo+rw Nov 02 11:00:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f73bfea8-5896-41a5-a4d0-b6d68eb66bd1 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:09 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.info Nov 02 11:00:09 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:10 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f73bfea8-5896-41a5-a4d0-b6d68eb66bd1 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.info" returned: 0 in 0.283s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f73bfea8-5896-41a5-a4d0-b6d68eb66bd1 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.057s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:10 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f73bfea8-5896-41a5-a4d0-b6d68eb66bd1 tempest-ProjectMemberTests-1266221133 None] Create snapshot completed successfully Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Flow 'volume_create_manager' (3ec7f9c4-f8c0-4125-9501-4ea8e1ff3c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df516a5-8435-460d-afbe-dc14024baa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df516a5-8435-460d-afbe-dc14024baa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1624146143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3e19d8-f0fb-4544-9725-3759f005e8ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8afed4a85cad405da31d9ce6ee12914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:10Z,use_quota=True,user_id='9eb9e1e32bee4b2d9fb7786b3e8622f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3217b1-aab2-4c13-975a-20ffb8938267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3217b1-aab2-4c13-975a-20ffb8938267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcfc7c36-02f0-49f3-9567-0fa1db7233d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcfc7c36-02f0-49f3-9567-0fa1db7233d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b3e19d8-f0fb-4544-9725-3759f005e8ac', 'volume_name': 'volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9c43c4-1ff4-442a-868b-5cc4dc725206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9c43c4-1ff4-442a-868b-5cc4dc725206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b009e01f-01cb-4a6d-b78c-44d066765676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:10 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Volume 8b3e19d8-f0fb-4544-9725-3759f005e8ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac', 'volume_size': 1} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1624146143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3e19d8-f0fb-4544-9725-3759f005e8ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8afed4a85cad405da31d9ce6ee12914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:10Z,use_quota=True,user_id='9eb9e1e32bee4b2d9fb7786b3e8622f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Creating volume 8b3e19d8-f0fb-4544-9725-3759f005e8ac {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:00:10 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:10 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac 1073741824 Nov 02 11:00:10 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:10 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac 1073741824" returned: 0 in 0.410s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:10 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac Nov 02 11:00:10 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:10 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac" returned: 0 in 0.241s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:00:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b009e01f-01cb-4a6d-b78c-44d066765676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128edf3c-d155-4bf4-befe-010ec6371c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:11 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Volume volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac (8b3e19d8-f0fb-4544-9725-3759f005e8ac): created successfully Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128edf3c-d155-4bf4-befe-010ec6371c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Flow 'volume_create_manager' (3ec7f9c4-f8c0-4125-9501-4ea8e1ff3c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:11 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-704e9e8e-f3b7-43b8-9a45-415ae006d14e tempest-ProjectReaderTests-597601906 None] Created volume successfully. Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-32c32f99-f217-4887-bc37-01d1d2143a3d-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-32c32f99-f217-4887-bc37-01d1d2143a3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-be068e22-b196-4f34-8252-22d9423714ba" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-be068e22-b196-4f34-8252-22d9423714ba" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-32c32f99-f217-4887-bc37-01d1d2143a3d" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-32c32f99-f217-4887-bc37-01d1d2143a3d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] Deleting offline snapshot 32c32f99-f217-4887-bc37-01d1d2143a3d of volume be068e22-b196-4f34-8252-22d9423714ba {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] snapshot_file for this snap is: volume-be068e22-b196-4f34-8252-22d9423714ba.32c32f99-f217-4887-bc37-01d1d2143a3d {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[26752d6c-3a25-4b98-9626-887827774281]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.32c32f99-f217-4887-bc37-01d1d2143a3d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-735b9b89-3da1-480c-a1fd-71130dc2d621 tempest-ProjectReaderTests-597601906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-735b9b89-3da1-480c-a1fd-71130dc2d621 tempest-ProjectReaderTests-597601906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-735b9b89-3da1-480c-a1fd-71130dc2d621 tempest-ProjectReaderTests-597601906 None] Creating offline snapshot e4a127f0-3025-4086-8f95-f60c33238d6f of volume 8b3e19d8-f0fb-4544-9725-3759f005e8ac {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34eb8b3-d6e0-46b6-b4ee-7a67a34f0a69]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-735b9b89-3da1-480c-a1fd-71130dc2d621 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:11 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.32c32f99-f217-4887-bc37-01d1d2143a3d Nov 02 11:00:11 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:11 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac Nov 02 11:00:11 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:11 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.32c32f99-f217-4887-bc37-01d1d2143a3d" returned: 0 in 0.378s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be068e22-b196-4f34-8252-22d9423714ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5b2bdd-9bb9-45ab-ab85-ed8d9b8e29e2]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:11 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-735b9b89-3da1-480c-a1fd-71130dc2d621 tempest-ProjectReaderTests-597601906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac" returned: 0 in 0.382s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-735b9b89-3da1-480c-a1fd-71130dc2d621 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.e4a127f0-3025-4086-8f95-f60c33238d6f 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:11 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.e4a127f0-3025-4086-8f95-f60c33238d6f 1G Nov 02 11:00:11 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:11 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba Nov 02 11:00:11 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:12 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba" returned: 0 in 0.375s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.32c32f99-f217-4887-bc37-01d1d2143a3d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:12 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.32c32f99-f217-4887-bc37-01d1d2143a3d Nov 02 11:00:12 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:12 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-735b9b89-3da1-480c-a1fd-71130dc2d621 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.e4a127f0-3025-4086-8f95-f60c33238d6f 1G" returned: 0 in 0.412s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-735b9b89-3da1-480c-a1fd-71130dc2d621 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.e4a127f0-3025-4086-8f95-f60c33238d6f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:12 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.e4a127f0-3025-4086-8f95-f60c33238d6f Nov 02 11:00:12 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:12 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.32c32f99-f217-4887-bc37-01d1d2143a3d" returned: 0 in 0.358s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.32c32f99-f217-4887-bc37-01d1d2143a3d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:12 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.32c32f99-f217-4887-bc37-01d1d2143a3d Nov 02 11:00:12 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:12 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-735b9b89-3da1-480c-a1fd-71130dc2d621 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.e4a127f0-3025-4086-8f95-f60c33238d6f" returned: 0 in 0.324s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:12 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-735b9b89-3da1-480c-a1fd-71130dc2d621 tempest-ProjectReaderTests-597601906 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.e4a127f0-3025-4086-8f95-f60c33238d6f is being set with open permissions: ugo+rw Nov 02 11:00:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-735b9b89-3da1-480c-a1fd-71130dc2d621 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.e4a127f0-3025-4086-8f95-f60c33238d6f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:12 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.e4a127f0-3025-4086-8f95-f60c33238d6f Nov 02 11:00:12 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:12 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba.32c32f99-f217-4887-bc37-01d1d2143a3d" returned: 0 in 0.254s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:12 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-735b9b89-3da1-480c-a1fd-71130dc2d621 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.e4a127f0-3025-4086-8f95-f60c33238d6f" returned: 0 in 0.250s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-32c32f99-f217-4887-bc37-01d1d2143a3d" released by "_delete_snapshot" :: held 1.501s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-be068e22-b196-4f34-8252-22d9423714ba" released by "delete_snapshot" :: held 1.529s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-735b9b89-3da1-480c-a1fd-71130dc2d621 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:12 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.info Nov 02 11:00:12 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:12 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] Created reservations ['5e370117-fac9-4c22-b73c-1adffb85a1f3', 'b7e2bc9c-bc63-4f24-bf16-53cb597642aa', '6226c911-b28d-4f98-8ffe-f0f6c10b9ca1', '1679c1c0-4af4-47a4-a956-c4122e59c211'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:12 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] Delete snapshot completed successfully. Nov 02 11:00:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-845eccd3-0859-4a30-bc78-84bf95ac2be3 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-32c32f99-f217-4887-bc37-01d1d2143a3d-delete_snapshot" released by "delete_snapshot" :: held 1.695s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:13 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-735b9b89-3da1-480c-a1fd-71130dc2d621 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.info" returned: 0 in 0.252s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:13 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-735b9b89-3da1-480c-a1fd-71130dc2d621 tempest-ProjectReaderTests-597601906 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.info is being set with open permissions: ugo+rw Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-735b9b89-3da1-480c-a1fd-71130dc2d621 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:13 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.info Nov 02 11:00:13 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:13 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-735b9b89-3da1-480c-a1fd-71130dc2d621 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.info" returned: 0 in 0.233s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-735b9b89-3da1-480c-a1fd-71130dc2d621 tempest-ProjectReaderTests-597601906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:13 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-735b9b89-3da1-480c-a1fd-71130dc2d621 tempest-ProjectReaderTests-597601906 None] Create snapshot completed successfully Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-98ebd543-d937-43c6-a683-c9d0f33d2285 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-be068e22-b196-4f34-8252-22d9423714ba-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-98ebd543-d937-43c6-a683-c9d0f33d2285 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-be068e22-b196-4f34-8252-22d9423714ba-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-98ebd543-d937-43c6-a683-c9d0f33d2285 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-be068e22-b196-4f34-8252-22d9423714ba" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-98ebd543-d937-43c6-a683-c9d0f33d2285 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-be068e22-b196-4f34-8252-22d9423714ba" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-e4a127f0-3025-4086-8f95-f60c33238d6f-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6b422d-a668-4e2a-b277-8bb602277991]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-98ebd543-d937-43c6-a683-c9d0f33d2285 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] Lock "cinder-e4a127f0-3025-4086-8f95-f60c33238d6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-quobyte-8b3e19d8-f0fb-4544-9725-3759f005e8ac" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-8b3e19d8-f0fb-4544-9725-3759f005e8ac" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-quobyte-e4a127f0-3025-4086-8f95-f60c33238d6f" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-e4a127f0-3025-4086-8f95-f60c33238d6f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] Deleting offline snapshot e4a127f0-3025-4086-8f95-f60c33238d6f of volume 8b3e19d8-f0fb-4544-9725-3759f005e8ac {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] snapshot_file for this snap is: volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.e4a127f0-3025-4086-8f95-f60c33238d6f {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[964dfc69-3f61-4730-9697-ae598e5154a3]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.e4a127f0-3025-4086-8f95-f60c33238d6f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:13 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba Nov 02 11:00:13 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:13 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.e4a127f0-3025-4086-8f95-f60c33238d6f Nov 02 11:00:13 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:13 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-98ebd543-d937-43c6-a683-c9d0f33d2285 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba" returned: 0 in 0.369s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-98ebd543-d937-43c6-a683-c9d0f33d2285 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:13 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba Nov 02 11:00:13 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:14 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.e4a127f0-3025-4086-8f95-f60c33238d6f" returned: 0 in 0.362s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:00:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0fb993-b00d-4ad4-a563-b29c758fc470]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:14 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac Nov 02 11:00:14 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:14 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-98ebd543-d937-43c6-a683-c9d0f33d2285 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-be068e22-b196-4f34-8252-22d9423714ba" returned: 0 in 0.270s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-98ebd543-d937-43c6-a683-c9d0f33d2285 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-be068e22-b196-4f34-8252-22d9423714ba" released by "delete_volume" :: held 0.716s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:14 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-98ebd543-d937-43c6-a683-c9d0f33d2285 tempest-ProjectMemberTests-1266221133 None] Created reservations ['4d4faca2-adcf-4b68-9cca-dec7e7c7af01', 'e62e7e86-b9d4-485b-ae46-06ffa0e23b31', 'b82f4ecc-0b46-46fc-b309-3956d7e4f3f2', 'fbc37c1b-3715-4a6b-a5a3-6e06916ece91'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-98ebd543-d937-43c6-a683-c9d0f33d2285 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-98ebd543-d937-43c6-a683-c9d0f33d2285 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-98ebd543-d937-43c6-a683-c9d0f33d2285 tempest-ProjectMemberTests-1266221133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-98ebd543-d937-43c6-a683-c9d0f33d2285 tempest-ProjectMemberTests-1266221133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-98ebd543-d937-43c6-a683-c9d0f33d2285 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-98ebd543-d937-43c6-a683-c9d0f33d2285 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:14 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 11:00:14 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:14 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac" returned: 0 in 0.355s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.e4a127f0-3025-4086-8f95-f60c33238d6f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:14 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.e4a127f0-3025-4086-8f95-f60c33238d6f Nov 02 11:00:14 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:14 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-98ebd543-d937-43c6-a683-c9d0f33d2285 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.258s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:14 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-98ebd543-d937-43c6-a683-c9d0f33d2285 tempest-ProjectMemberTests-1266221133 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-98ebd543-d937-43c6-a683-c9d0f33d2285 tempest-ProjectMemberTests-1266221133 None] Deleted volume successfully. Nov 02 11:00:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-98ebd543-d937-43c6-a683-c9d0f33d2285 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-be068e22-b196-4f34-8252-22d9423714ba-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:14 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.e4a127f0-3025-4086-8f95-f60c33238d6f" returned: 0 in 0.347s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.e4a127f0-3025-4086-8f95-f60c33238d6f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:14 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.e4a127f0-3025-4086-8f95-f60c33238d6f Nov 02 11:00:14 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:15 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac.e4a127f0-3025-4086-8f95-f60c33238d6f" returned: 0 in 0.262s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-e4a127f0-3025-4086-8f95-f60c33238d6f" released by "_delete_snapshot" :: held 1.443s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-8b3e19d8-f0fb-4544-9725-3759f005e8ac" released by "delete_snapshot" :: held 1.468s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Flow 'volume_create_manager' (a9d39e54-7ff2-4382-b2e8-783b36eecb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71fe6ebd-d783-4ee3-9d63-9694e51c8a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71fe6ebd-d783-4ee3-9d63-9694e51c8a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-878551326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544361d6-985a-40ca-9798-05cb9c9fbafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de43071a1c4348bf85c649c8f77ffcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:15Z,use_quota=True,user_id='eeeb85b0d7c743069682afbcc7ffccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e55ce75-f775-4a3c-a7a6-47a66f9e6458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e55ce75-f775-4a3c-a7a6-47a66f9e6458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9968726a-df8b-4e72-b95f-72f4c35da332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9968726a-df8b-4e72-b95f-72f4c35da332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '544361d6-985a-40ca-9798-05cb9c9fbafc', 'volume_name': 'volume-544361d6-985a-40ca-9798-05cb9c9fbafc', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d00b0c-579b-4aaa-bc53-04fd73baa758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d00b0c-579b-4aaa-bc53-04fd73baa758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de66e8a2-3cf6-4daf-86d2-72e528ca6007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:15 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Volume 544361d6-985a-40ca-9798-05cb9c9fbafc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-544361d6-985a-40ca-9798-05cb9c9fbafc', 'volume_size': 1} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-878551326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544361d6-985a-40ca-9798-05cb9c9fbafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de43071a1c4348bf85c649c8f77ffcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:15Z,use_quota=True,user_id='eeeb85b0d7c743069682afbcc7ffccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Creating volume 544361d6-985a-40ca-9798-05cb9c9fbafc {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:00:15 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:15 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc 1073741824 Nov 02 11:00:15 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] Created reservations ['72e299c6-663b-495e-aa4d-c5e6bef28923', 'ec1753e6-cf83-41a2-895e-24337a2977d6', '986f293a-f961-43a5-9253-c994babe0a90', 'aa32b369-2e39-48c2-9ca2-8a5abe868990'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:15 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] Delete snapshot completed successfully. Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6172a0dd-074f-41f6-8e6a-f52812a9c121 tempest-ProjectReaderTests-597601906 None] Lock "cinder-e4a127f0-3025-4086-8f95-f60c33238d6f-delete_snapshot" released by "delete_snapshot" :: held 1.721s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:15 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc 1073741824" returned: 0 in 0.408s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:15 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc Nov 02 11:00:15 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8d22a3fa-6a7b-4e6d-a93c-4b7e36f7e32b tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-8b3e19d8-f0fb-4544-9725-3759f005e8ac-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8d22a3fa-6a7b-4e6d-a93c-4b7e36f7e32b tempest-ProjectReaderTests-597601906 None] Lock "cinder-8b3e19d8-f0fb-4544-9725-3759f005e8ac-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8d22a3fa-6a7b-4e6d-a93c-4b7e36f7e32b tempest-ProjectReaderTests-597601906 None] Acquiring lock "cinder-quobyte-8b3e19d8-f0fb-4544-9725-3759f005e8ac" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8d22a3fa-6a7b-4e6d-a93c-4b7e36f7e32b tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-8b3e19d8-f0fb-4544-9725-3759f005e8ac" acquired by "delete_volume" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3f3497-c79f-45c4-993e-9849411dfa27]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d22a3fa-6a7b-4e6d-a93c-4b7e36f7e32b tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:15 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc" returned: 0 in 0.260s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de66e8a2-3cf6-4daf-86d2-72e528ca6007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-544361d6-985a-40ca-9798-05cb9c9fbafc', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b9ac11-ed7c-4834-abfa-a8c8d9f31011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:15 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Volume volume-544361d6-985a-40ca-9798-05cb9c9fbafc (544361d6-985a-40ca-9798-05cb9c9fbafc): created successfully Nov 02 11:00:15 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac Nov 02 11:00:15 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b9ac11-ed7c-4834-abfa-a8c8d9f31011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Flow 'volume_create_manager' (a9d39e54-7ff2-4382-b2e8-783b36eecb3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:15 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-eb362722-f79b-4162-893d-9fb02a47b707 tempest-ProjectMemberTests-1266221133 None] Created volume successfully. Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bf939c95-9a05-48ca-a940-cdbaeb8d6efb tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bf939c95-9a05-48ca-a940-cdbaeb8d6efb tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:16 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d22a3fa-6a7b-4e6d-a93c-4b7e36f7e32b tempest-ProjectReaderTests-597601906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac" returned: 0 in 0.419s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d22a3fa-6a7b-4e6d-a93c-4b7e36f7e32b tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-bf939c95-9a05-48ca-a940-cdbaeb8d6efb tempest-ProjectMemberTests-1266221133 None] Creating offline snapshot 3c00f2bb-bf35-4bbb-9a27-0ba196138bf8 of volume 544361d6-985a-40ca-9798-05cb9c9fbafc {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:00:16 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac Nov 02 11:00:16 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[229a674e-be43-45ff-8edb-b09a178cf1d1]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bf939c95-9a05-48ca-a940-cdbaeb8d6efb tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:16 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc Nov 02 11:00:16 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:16 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d22a3fa-6a7b-4e6d-a93c-4b7e36f7e32b tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-8b3e19d8-f0fb-4544-9725-3759f005e8ac" returned: 0 in 0.248s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8d22a3fa-6a7b-4e6d-a93c-4b7e36f7e32b tempest-ProjectReaderTests-597601906 None] Lock "cinder-quobyte-8b3e19d8-f0fb-4544-9725-3759f005e8ac" released by "delete_volume" :: held 0.730s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-8d22a3fa-6a7b-4e6d-a93c-4b7e36f7e32b tempest-ProjectReaderTests-597601906 None] Created reservations ['7c8c08e4-d95d-4e2f-b189-31920c310599', 'd0a25037-afbc-4474-acca-63a52c507011', 'd802886d-a627-4385-ad3a-72c4c5365e9e', 'b08bb1c0-277c-4015-92a3-b66fe83bcf17'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8d22a3fa-6a7b-4e6d-a93c-4b7e36f7e32b tempest-ProjectReaderTests-597601906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8d22a3fa-6a7b-4e6d-a93c-4b7e36f7e32b tempest-ProjectReaderTests-597601906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8d22a3fa-6a7b-4e6d-a93c-4b7e36f7e32b tempest-ProjectReaderTests-597601906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8d22a3fa-6a7b-4e6d-a93c-4b7e36f7e32b tempest-ProjectReaderTests-597601906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8d22a3fa-6a7b-4e6d-a93c-4b7e36f7e32b tempest-ProjectReaderTests-597601906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d22a3fa-6a7b-4e6d-a93c-4b7e36f7e32b tempest-ProjectReaderTests-597601906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:16 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 11:00:16 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:16 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bf939c95-9a05-48ca-a940-cdbaeb8d6efb tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc" returned: 0 in 0.383s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bf939c95-9a05-48ca-a940-cdbaeb8d6efb tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.3c00f2bb-bf35-4bbb-9a27-0ba196138bf8 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:16 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.3c00f2bb-bf35-4bbb-9a27-0ba196138bf8 1G Nov 02 11:00:16 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:16 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d22a3fa-6a7b-4e6d-a93c-4b7e36f7e32b tempest-ProjectReaderTests-597601906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.257s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-8d22a3fa-6a7b-4e6d-a93c-4b7e36f7e32b tempest-ProjectReaderTests-597601906 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:16 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8d22a3fa-6a7b-4e6d-a93c-4b7e36f7e32b tempest-ProjectReaderTests-597601906 None] Deleted volume successfully. Nov 02 11:00:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8d22a3fa-6a7b-4e6d-a93c-4b7e36f7e32b tempest-ProjectReaderTests-597601906 None] Lock "cinder-8b3e19d8-f0fb-4544-9725-3759f005e8ac-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:17 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bf939c95-9a05-48ca-a940-cdbaeb8d6efb tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.3c00f2bb-bf35-4bbb-9a27-0ba196138bf8 1G" returned: 0 in 0.431s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bf939c95-9a05-48ca-a940-cdbaeb8d6efb tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-544361d6-985a-40ca-9798-05cb9c9fbafc -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.3c00f2bb-bf35-4bbb-9a27-0ba196138bf8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:17 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-544361d6-985a-40ca-9798-05cb9c9fbafc -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.3c00f2bb-bf35-4bbb-9a27-0ba196138bf8 Nov 02 11:00:17 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:17 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bf939c95-9a05-48ca-a940-cdbaeb8d6efb tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-544361d6-985a-40ca-9798-05cb9c9fbafc -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.3c00f2bb-bf35-4bbb-9a27-0ba196138bf8" returned: 0 in 0.289s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:17 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-bf939c95-9a05-48ca-a940-cdbaeb8d6efb tempest-ProjectMemberTests-1266221133 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.3c00f2bb-bf35-4bbb-9a27-0ba196138bf8 is being set with open permissions: ugo+rw Nov 02 11:00:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bf939c95-9a05-48ca-a940-cdbaeb8d6efb tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.3c00f2bb-bf35-4bbb-9a27-0ba196138bf8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:17 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.3c00f2bb-bf35-4bbb-9a27-0ba196138bf8 Nov 02 11:00:17 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:17 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bf939c95-9a05-48ca-a940-cdbaeb8d6efb tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.3c00f2bb-bf35-4bbb-9a27-0ba196138bf8" returned: 0 in 0.238s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bf939c95-9a05-48ca-a940-cdbaeb8d6efb tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:17 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.info Nov 02 11:00:17 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:17 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bf939c95-9a05-48ca-a940-cdbaeb8d6efb tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.info" returned: 0 in 0.271s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:17 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-bf939c95-9a05-48ca-a940-cdbaeb8d6efb tempest-ProjectMemberTests-1266221133 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.info is being set with open permissions: ugo+rw Nov 02 11:00:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bf939c95-9a05-48ca-a940-cdbaeb8d6efb tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:17 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.info Nov 02 11:00:17 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:18 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bf939c95-9a05-48ca-a940-cdbaeb8d6efb tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.info" returned: 0 in 0.246s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bf939c95-9a05-48ca-a940-cdbaeb8d6efb tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:18 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-bf939c95-9a05-48ca-a940-cdbaeb8d6efb tempest-ProjectMemberTests-1266221133 None] Create snapshot completed successfully Nov 02 11:00:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-3c00f2bb-bf35-4bbb-9a27-0ba196138bf8-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] Lock "cinder-3c00f2bb-bf35-4bbb-9a27-0ba196138bf8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-544361d6-985a-40ca-9798-05cb9c9fbafc" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-544361d6-985a-40ca-9798-05cb9c9fbafc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-3c00f2bb-bf35-4bbb-9a27-0ba196138bf8" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-3c00f2bb-bf35-4bbb-9a27-0ba196138bf8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] Deleting offline snapshot 3c00f2bb-bf35-4bbb-9a27-0ba196138bf8 of volume 544361d6-985a-40ca-9798-05cb9c9fbafc {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:00:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] snapshot_file for this snap is: volume-544361d6-985a-40ca-9798-05cb9c9fbafc.3c00f2bb-bf35-4bbb-9a27-0ba196138bf8 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:00:18 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3464945-826e-426b-a2cc-57cf6b5c9c2a]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.3c00f2bb-bf35-4bbb-9a27-0ba196138bf8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:18 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.3c00f2bb-bf35-4bbb-9a27-0ba196138bf8 Nov 02 11:00:18 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:18 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.3c00f2bb-bf35-4bbb-9a27-0ba196138bf8" returned: 0 in 0.370s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-544361d6-985a-40ca-9798-05cb9c9fbafc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:00:18 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7093698c-6d1a-483d-8412-479b7ec50252]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:18 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc Nov 02 11:00:18 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:19 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc" returned: 0 in 0.371s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.3c00f2bb-bf35-4bbb-9a27-0ba196138bf8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:19 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.3c00f2bb-bf35-4bbb-9a27-0ba196138bf8 Nov 02 11:00:19 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:19 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.3c00f2bb-bf35-4bbb-9a27-0ba196138bf8" returned: 0 in 0.349s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.3c00f2bb-bf35-4bbb-9a27-0ba196138bf8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:19 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.3c00f2bb-bf35-4bbb-9a27-0ba196138bf8 Nov 02 11:00:19 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:19 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc.3c00f2bb-bf35-4bbb-9a27-0ba196138bf8" returned: 0 in 0.245s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-3c00f2bb-bf35-4bbb-9a27-0ba196138bf8" released by "_delete_snapshot" :: held 1.447s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-544361d6-985a-40ca-9798-05cb9c9fbafc" released by "delete_snapshot" :: held 1.468s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:19 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] Created reservations ['31fb68f9-b60f-413f-8641-e54959cef0d0', 'd9c04308-5d6f-4961-abb0-479d2c19b63a', '710d6960-b116-47fa-87c4-4f9ea786f314', 'c7c7f7ce-a1f6-4ebb-a50c-32d9b917affb'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:19 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] Delete snapshot completed successfully. Nov 02 11:00:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4921b11b-a600-44ab-ada0-e15925e6abae tempest-ProjectMemberTests-1266221133 None] Lock "cinder-3c00f2bb-bf35-4bbb-9a27-0ba196138bf8-delete_snapshot" released by "delete_snapshot" :: held 1.593s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Flow 'volume_create_manager' (40f33494-c0c2-4134-851e-7c5034a86386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a7ebf3-9877-4f5e-a821-cfe9f6c837a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a7ebf3-9877-4f5e-a821-cfe9f6c837a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1863675091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a42b4116-c570-4316-ac55-50b4b9a5d0df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a9219dd31ce42bfa05bb6340d3884a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:20Z,use_quota=True,user_id='cab86c2c0f124131bb6d0656e7a791c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c404dc34-a60f-44a4-94e7-0cc5f03485c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c404dc34-a60f-44a4-94e7-0cc5f03485c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7925ec98-9b89-4cda-b8c9-797203a72982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7925ec98-9b89-4cda-b8c9-797203a72982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a42b4116-c570-4316-ac55-50b4b9a5d0df', 'volume_name': 'volume-a42b4116-c570-4316-ac55-50b4b9a5d0df', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e240fec3-d065-4202-8c84-1a5acc3f44aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e240fec3-d065-4202-8c84-1a5acc3f44aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda10cce-e74d-470b-9b3e-8fc4dcf48aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:20 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Volume a42b4116-c570-4316-ac55-50b4b9a5d0df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a42b4116-c570-4316-ac55-50b4b9a5d0df', 'volume_size': 1} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1863675091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a42b4116-c570-4316-ac55-50b4b9a5d0df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a9219dd31ce42bfa05bb6340d3884a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:20Z,use_quota=True,user_id='cab86c2c0f124131bb6d0656e7a791c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Creating volume a42b4116-c570-4316-ac55-50b4b9a5d0df {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:00:20 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a42b4116-c570-4316-ac55-50b4b9a5d0df 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-636381a8-9514-4927-bd99-e47426455afc tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-544361d6-985a-40ca-9798-05cb9c9fbafc-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:20 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a42b4116-c570-4316-ac55-50b4b9a5d0df 1073741824 Nov 02 11:00:20 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-636381a8-9514-4927-bd99-e47426455afc tempest-ProjectMemberTests-1266221133 None] Lock "cinder-544361d6-985a-40ca-9798-05cb9c9fbafc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-636381a8-9514-4927-bd99-e47426455afc tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-544361d6-985a-40ca-9798-05cb9c9fbafc" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-636381a8-9514-4927-bd99-e47426455afc tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-544361d6-985a-40ca-9798-05cb9c9fbafc" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc77d04-7282-4657-98c5-31777ffe571e]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-636381a8-9514-4927-bd99-e47426455afc tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:20 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc Nov 02 11:00:20 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:20 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a42b4116-c570-4316-ac55-50b4b9a5d0df 1073741824" returned: 0 in 0.427s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a42b4116-c570-4316-ac55-50b4b9a5d0df {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:21 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a42b4116-c570-4316-ac55-50b4b9a5d0df Nov 02 11:00:21 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:21 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-636381a8-9514-4927-bd99-e47426455afc tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc" returned: 0 in 0.374s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-636381a8-9514-4927-bd99-e47426455afc tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:21 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc Nov 02 11:00:21 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:21 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a42b4116-c570-4316-ac55-50b4b9a5d0df" returned: 0 in 0.249s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda10cce-e74d-470b-9b3e-8fc4dcf48aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a42b4116-c570-4316-ac55-50b4b9a5d0df', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1220d62-6077-48b5-8d6a-fa7135b1ed83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:21 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-636381a8-9514-4927-bd99-e47426455afc tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-544361d6-985a-40ca-9798-05cb9c9fbafc" returned: 0 in 0.247s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:21 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Volume volume-a42b4116-c570-4316-ac55-50b4b9a5d0df (a42b4116-c570-4316-ac55-50b4b9a5d0df): created successfully Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1220d62-6077-48b5-8d6a-fa7135b1ed83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Flow 'volume_create_manager' (40f33494-c0c2-4134-851e-7c5034a86386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-636381a8-9514-4927-bd99-e47426455afc tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-544361d6-985a-40ca-9798-05cb9c9fbafc" released by "delete_volume" :: held 0.697s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:21 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ed80b82f-f2fa-4241-a886-950b26350900 tempest-ProjectReaderTests-358232304 None] Created volume successfully. Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-636381a8-9514-4927-bd99-e47426455afc tempest-ProjectMemberTests-1266221133 None] Created reservations ['365134e2-e1e2-4260-8526-e7a67b760009', 'e85756e6-09a2-4d1d-bdac-680f6507babb', '3e0942d0-9d28-4a1a-af0e-fb39a3ff9763', 'c06ba622-0e18-4e74-bec4-7a8535507bfa'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-636381a8-9514-4927-bd99-e47426455afc tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-636381a8-9514-4927-bd99-e47426455afc tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-636381a8-9514-4927-bd99-e47426455afc tempest-ProjectMemberTests-1266221133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-636381a8-9514-4927-bd99-e47426455afc tempest-ProjectMemberTests-1266221133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-636381a8-9514-4927-bd99-e47426455afc tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-636381a8-9514-4927-bd99-e47426455afc tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:21 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 11:00:21 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a0cfa723-f704-4bdf-b482-1fede217867a tempest-ProjectReaderTests-358232304 None] Acquiring lock "cinder-a42b4116-c570-4316-ac55-50b4b9a5d0df-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a0cfa723-f704-4bdf-b482-1fede217867a tempest-ProjectReaderTests-358232304 None] Lock "cinder-a42b4116-c570-4316-ac55-50b4b9a5d0df-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a0cfa723-f704-4bdf-b482-1fede217867a tempest-ProjectReaderTests-358232304 None] Acquiring lock "cinder-quobyte-a42b4116-c570-4316-ac55-50b4b9a5d0df" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a0cfa723-f704-4bdf-b482-1fede217867a tempest-ProjectReaderTests-358232304 None] Lock "cinder-quobyte-a42b4116-c570-4316-ac55-50b4b9a5d0df" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:21 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-636381a8-9514-4927-bd99-e47426455afc tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.291s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-636381a8-9514-4927-bd99-e47426455afc tempest-ProjectMemberTests-1266221133 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:21 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-636381a8-9514-4927-bd99-e47426455afc tempest-ProjectMemberTests-1266221133 None] Deleted volume successfully. Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[503e72d0-4295-4135-8293-b9a454778816]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a0cfa723-f704-4bdf-b482-1fede217867a tempest-ProjectReaderTests-358232304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a42b4116-c570-4316-ac55-50b4b9a5d0df {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-636381a8-9514-4927-bd99-e47426455afc tempest-ProjectMemberTests-1266221133 None] Lock "cinder-544361d6-985a-40ca-9798-05cb9c9fbafc-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:21 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a42b4116-c570-4316-ac55-50b4b9a5d0df Nov 02 11:00:21 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:00:22 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Flow 'volume_create_manager' (60e03ef4-da43-4520-bcc5-d2830ff3096d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d842cb-3e94-4230-bc31-fc8ee9a76fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a0cfa723-f704-4bdf-b482-1fede217867a tempest-ProjectReaderTests-358232304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a42b4116-c570-4316-ac55-50b4b9a5d0df" returned: 0 in 0.416s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a0cfa723-f704-4bdf-b482-1fede217867a tempest-ProjectReaderTests-358232304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a42b4116-c570-4316-ac55-50b4b9a5d0df {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:22 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a42b4116-c570-4316-ac55-50b4b9a5d0df Nov 02 11:00:22 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d842cb-3e94-4230-bc31-fc8ee9a76fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-423484899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd570cff-2335-4e35-b4b9-debed0c1c78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de43071a1c4348bf85c649c8f77ffcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:22Z,use_quota=True,user_id='eeeb85b0d7c743069682afbcc7ffccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed2d11e-b1c8-4e14-9b2e-435bd4924c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed2d11e-b1c8-4e14-9b2e-435bd4924c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c59ecd59-f7f6-4adf-a196-585582c0015b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c59ecd59-f7f6-4adf-a196-585582c0015b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd570cff-2335-4e35-b4b9-debed0c1c78d', 'volume_name': 'volume-dd570cff-2335-4e35-b4b9-debed0c1c78d', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3628936d-ec45-4228-a431-f312faa98f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3628936d-ec45-4228-a431-f312faa98f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c5af25a-5c69-461c-9935-ee3de5deb931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:22 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Volume dd570cff-2335-4e35-b4b9-debed0c1c78d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd570cff-2335-4e35-b4b9-debed0c1c78d', 'volume_size': 1} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-423484899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd570cff-2335-4e35-b4b9-debed0c1c78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de43071a1c4348bf85c649c8f77ffcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:22Z,use_quota=True,user_id='eeeb85b0d7c743069682afbcc7ffccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Creating volume dd570cff-2335-4e35-b4b9-debed0c1c78d {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:00:22 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:22 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d 1073741824 Nov 02 11:00:22 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:22 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a0cfa723-f704-4bdf-b482-1fede217867a tempest-ProjectReaderTests-358232304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a42b4116-c570-4316-ac55-50b4b9a5d0df" returned: 0 in 0.250s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a0cfa723-f704-4bdf-b482-1fede217867a tempest-ProjectReaderTests-358232304 None] Lock "cinder-quobyte-a42b4116-c570-4316-ac55-50b4b9a5d0df" released by "delete_volume" :: held 0.721s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a0cfa723-f704-4bdf-b482-1fede217867a tempest-ProjectReaderTests-358232304 None] Created reservations ['3cd24545-98c5-48d6-a1a1-c088a4eb1824', '631996e6-6240-4054-81cf-07818d982dd7', '98eca90c-80d4-4476-85f7-b3b20bda56fa', '673b311d-e6f2-4b36-91a4-a492bf9ac970'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a0cfa723-f704-4bdf-b482-1fede217867a tempest-ProjectReaderTests-358232304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a0cfa723-f704-4bdf-b482-1fede217867a tempest-ProjectReaderTests-358232304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a0cfa723-f704-4bdf-b482-1fede217867a tempest-ProjectReaderTests-358232304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a0cfa723-f704-4bdf-b482-1fede217867a tempest-ProjectReaderTests-358232304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a0cfa723-f704-4bdf-b482-1fede217867a tempest-ProjectReaderTests-358232304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a0cfa723-f704-4bdf-b482-1fede217867a tempest-ProjectReaderTests-358232304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:22 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 11:00:22 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:22 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d 1073741824" returned: 0 in 0.441s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:22 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d Nov 02 11:00:22 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:22 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a0cfa723-f704-4bdf-b482-1fede217867a tempest-ProjectReaderTests-358232304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.270s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-a0cfa723-f704-4bdf-b482-1fede217867a tempest-ProjectReaderTests-358232304 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:22 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a0cfa723-f704-4bdf-b482-1fede217867a tempest-ProjectReaderTests-358232304 None] Deleted volume successfully. Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a0cfa723-f704-4bdf-b482-1fede217867a tempest-ProjectReaderTests-358232304 None] Lock "cinder-a42b4116-c570-4316-ac55-50b4b9a5d0df-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:22 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d" returned: 0 in 0.261s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:00:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c5af25a-5c69-461c-9935-ee3de5deb931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd570cff-2335-4e35-b4b9-debed0c1c78d', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77eb9c44-73fc-4fa8-9674-8e7ba29d4e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:23 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Volume volume-dd570cff-2335-4e35-b4b9-debed0c1c78d (dd570cff-2335-4e35-b4b9-debed0c1c78d): created successfully Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77eb9c44-73fc-4fa8-9674-8e7ba29d4e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Flow 'volume_create_manager' (60e03ef4-da43-4520-bcc5-d2830ff3096d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-994d3008-8191-4bff-8faf-f12d730e87ad tempest-ProjectMemberTests-1266221133 None] Created volume successfully. Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Flow 'volume_create_manager' (5ae9e699-a9cf-4129-be98-b8a49796eaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c266b2-e112-4e21-ba0b-ca70d7690843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c266b2-e112-4e21-ba0b-ca70d7690843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-707344114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d87a862-5e04-42f4-825e-75d1c5cdbfb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a9219dd31ce42bfa05bb6340d3884a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:23Z,use_quota=True,user_id='cab86c2c0f124131bb6d0656e7a791c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f123e43-25a0-45a0-88e9-fa26b833a1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f123e43-25a0-45a0-88e9-fa26b833a1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6338b837-7832-4085-b0be-5a2a85ec780c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6338b837-7832-4085-b0be-5a2a85ec780c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d87a862-5e04-42f4-825e-75d1c5cdbfb5', 'volume_name': 'volume-1d87a862-5e04-42f4-825e-75d1c5cdbfb5', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa4680f-c66a-4fae-81dd-e01564275793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa4680f-c66a-4fae-81dd-e01564275793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a257044-3c1e-4485-b45a-62ef11248394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:23 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Volume 1d87a862-5e04-42f4-825e-75d1c5cdbfb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d87a862-5e04-42f4-825e-75d1c5cdbfb5', 'volume_size': 1} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-707344114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d87a862-5e04-42f4-825e-75d1c5cdbfb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a9219dd31ce42bfa05bb6340d3884a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:23Z,use_quota=True,user_id='cab86c2c0f124131bb6d0656e7a791c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Creating volume 1d87a862-5e04-42f4-825e-75d1c5cdbfb5 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:00:23 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1d87a862-5e04-42f4-825e-75d1c5cdbfb5 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:23 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1d87a862-5e04-42f4-825e-75d1c5cdbfb5 1073741824 Nov 02 11:00:23 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-625652bd-f91d-46a7-b17a-69213d4e2022 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:23 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1d87a862-5e04-42f4-825e-75d1c5cdbfb5 1073741824" returned: 0 in 0.410s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1d87a862-5e04-42f4-825e-75d1c5cdbfb5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:23 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1d87a862-5e04-42f4-825e-75d1c5cdbfb5 Nov 02 11:00:23 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:24 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1d87a862-5e04-42f4-825e-75d1c5cdbfb5" returned: 0 in 0.234s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-625652bd-f91d-46a7-b17a-69213d4e2022 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.649s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a257044-3c1e-4485-b45a-62ef11248394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d87a862-5e04-42f4-825e-75d1c5cdbfb5', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e30a365-5598-410a-ab75-49069d806fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-625652bd-f91d-46a7-b17a-69213d4e2022 tempest-ProjectMemberTests-1266221133 None] Creating offline snapshot 01860e2f-13d9-4904-bb5e-f93727386df4 of volume dd570cff-2335-4e35-b4b9-debed0c1c78d {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:00:24 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Volume volume-1d87a862-5e04-42f4-825e-75d1c5cdbfb5 (1d87a862-5e04-42f4-825e-75d1c5cdbfb5): created successfully Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e30a365-5598-410a-ab75-49069d806fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Flow 'volume_create_manager' (5ae9e699-a9cf-4129-be98-b8a49796eaab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3feab0d9-a0f6-4638-b26d-9778facfab0d]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-625652bd-f91d-46a7-b17a-69213d4e2022 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:24 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5cbde07d-2281-4be7-a2d1-2a854ddaafb2 tempest-ProjectReaderTests-358232304 None] Created volume successfully. Nov 02 11:00:24 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d Nov 02 11:00:24 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f5b32798-4357-4c3f-941a-c41b2a4a595a tempest-ProjectReaderTests-358232304 None] Acquiring lock "cinder-1d87a862-5e04-42f4-825e-75d1c5cdbfb5-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f5b32798-4357-4c3f-941a-c41b2a4a595a tempest-ProjectReaderTests-358232304 None] Lock "cinder-1d87a862-5e04-42f4-825e-75d1c5cdbfb5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f5b32798-4357-4c3f-941a-c41b2a4a595a tempest-ProjectReaderTests-358232304 None] Acquiring lock "cinder-quobyte-1d87a862-5e04-42f4-825e-75d1c5cdbfb5" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f5b32798-4357-4c3f-941a-c41b2a4a595a tempest-ProjectReaderTests-358232304 None] Lock "cinder-quobyte-1d87a862-5e04-42f4-825e-75d1c5cdbfb5" acquired by "delete_volume" :: waited 0.012s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed0bf9d-1640-460f-b736-cc81c7f8fba1]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f5b32798-4357-4c3f-941a-c41b2a4a595a tempest-ProjectReaderTests-358232304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1d87a862-5e04-42f4-825e-75d1c5cdbfb5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:24 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1d87a862-5e04-42f4-825e-75d1c5cdbfb5 Nov 02 11:00:24 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:24 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-625652bd-f91d-46a7-b17a-69213d4e2022 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d" returned: 0 in 0.416s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-625652bd-f91d-46a7-b17a-69213d4e2022 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.01860e2f-13d9-4904-bb5e-f93727386df4 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:24 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.01860e2f-13d9-4904-bb5e-f93727386df4 1G Nov 02 11:00:24 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:24 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f5b32798-4357-4c3f-941a-c41b2a4a595a tempest-ProjectReaderTests-358232304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1d87a862-5e04-42f4-825e-75d1c5cdbfb5" returned: 0 in 0.367s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f5b32798-4357-4c3f-941a-c41b2a4a595a tempest-ProjectReaderTests-358232304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1d87a862-5e04-42f4-825e-75d1c5cdbfb5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:24 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1d87a862-5e04-42f4-825e-75d1c5cdbfb5 Nov 02 11:00:24 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:25 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-625652bd-f91d-46a7-b17a-69213d4e2022 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.01860e2f-13d9-4904-bb5e-f93727386df4 1G" returned: 0 in 0.406s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-625652bd-f91d-46a7-b17a-69213d4e2022 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd570cff-2335-4e35-b4b9-debed0c1c78d -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.01860e2f-13d9-4904-bb5e-f93727386df4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:25 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd570cff-2335-4e35-b4b9-debed0c1c78d -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.01860e2f-13d9-4904-bb5e-f93727386df4 Nov 02 11:00:25 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:25 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f5b32798-4357-4c3f-941a-c41b2a4a595a tempest-ProjectReaderTests-358232304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-1d87a862-5e04-42f4-825e-75d1c5cdbfb5" returned: 0 in 0.251s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f5b32798-4357-4c3f-941a-c41b2a4a595a tempest-ProjectReaderTests-358232304 None] Lock "cinder-quobyte-1d87a862-5e04-42f4-825e-75d1c5cdbfb5" released by "delete_volume" :: held 0.661s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:25 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-f5b32798-4357-4c3f-941a-c41b2a4a595a tempest-ProjectReaderTests-358232304 None] Created reservations ['932d26c5-3ca4-4542-ade7-f97798291482', '3c573d3b-5cbf-490d-8899-7d676973a3a7', '87e5aa20-f5ee-4070-a49f-f01ec32e822f', '43266963-0de3-4172-8c43-02dd23873dcd'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f5b32798-4357-4c3f-941a-c41b2a4a595a tempest-ProjectReaderTests-358232304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f5b32798-4357-4c3f-941a-c41b2a4a595a tempest-ProjectReaderTests-358232304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f5b32798-4357-4c3f-941a-c41b2a4a595a tempest-ProjectReaderTests-358232304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f5b32798-4357-4c3f-941a-c41b2a4a595a tempest-ProjectReaderTests-358232304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f5b32798-4357-4c3f-941a-c41b2a4a595a tempest-ProjectReaderTests-358232304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f5b32798-4357-4c3f-941a-c41b2a4a595a tempest-ProjectReaderTests-358232304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:25 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 11:00:25 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:25 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-625652bd-f91d-46a7-b17a-69213d4e2022 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd570cff-2335-4e35-b4b9-debed0c1c78d -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.01860e2f-13d9-4904-bb5e-f93727386df4" returned: 0 in 0.302s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:25 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-625652bd-f91d-46a7-b17a-69213d4e2022 tempest-ProjectMemberTests-1266221133 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.01860e2f-13d9-4904-bb5e-f93727386df4 is being set with open permissions: ugo+rw Nov 02 11:00:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-625652bd-f91d-46a7-b17a-69213d4e2022 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.01860e2f-13d9-4904-bb5e-f93727386df4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:25 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.01860e2f-13d9-4904-bb5e-f93727386df4 Nov 02 11:00:25 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:25 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f5b32798-4357-4c3f-941a-c41b2a4a595a tempest-ProjectReaderTests-358232304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.259s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:25 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-f5b32798-4357-4c3f-941a-c41b2a4a595a tempest-ProjectReaderTests-358232304 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:25 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f5b32798-4357-4c3f-941a-c41b2a4a595a tempest-ProjectReaderTests-358232304 None] Deleted volume successfully. Nov 02 11:00:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f5b32798-4357-4c3f-941a-c41b2a4a595a tempest-ProjectReaderTests-358232304 None] Lock "cinder-1d87a862-5e04-42f4-825e-75d1c5cdbfb5-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:25 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-625652bd-f91d-46a7-b17a-69213d4e2022 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.01860e2f-13d9-4904-bb5e-f93727386df4" returned: 0 in 0.251s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-625652bd-f91d-46a7-b17a-69213d4e2022 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:25 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.info Nov 02 11:00:25 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:25 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-625652bd-f91d-46a7-b17a-69213d4e2022 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.info" returned: 0 in 0.266s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:25 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-625652bd-f91d-46a7-b17a-69213d4e2022 tempest-ProjectMemberTests-1266221133 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.info is being set with open permissions: ugo+rw Nov 02 11:00:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-625652bd-f91d-46a7-b17a-69213d4e2022 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:25 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.info Nov 02 11:00:25 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:26 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-625652bd-f91d-46a7-b17a-69213d4e2022 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.info" returned: 0 in 0.251s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-625652bd-f91d-46a7-b17a-69213d4e2022 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:26 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-625652bd-f91d-46a7-b17a-69213d4e2022 tempest-ProjectMemberTests-1266221133 None] Create snapshot completed successfully Nov 02 11:00:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-01860e2f-13d9-4904-bb5e-f93727386df4-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-01860e2f-13d9-4904-bb5e-f93727386df4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-dd570cff-2335-4e35-b4b9-debed0c1c78d" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-dd570cff-2335-4e35-b4b9-debed0c1c78d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-01860e2f-13d9-4904-bb5e-f93727386df4" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-01860e2f-13d9-4904-bb5e-f93727386df4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] Deleting offline snapshot 01860e2f-13d9-4904-bb5e-f93727386df4 of volume dd570cff-2335-4e35-b4b9-debed0c1c78d {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:00:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] snapshot_file for this snap is: volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.01860e2f-13d9-4904-bb5e-f93727386df4 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:00:26 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72b87a2-2969-4551-96a7-160038e85c15]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.01860e2f-13d9-4904-bb5e-f93727386df4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:26 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.01860e2f-13d9-4904-bb5e-f93727386df4 Nov 02 11:00:26 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:27 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.01860e2f-13d9-4904-bb5e-f93727386df4" returned: 0 in 0.396s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd570cff-2335-4e35-b4b9-debed0c1c78d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:00:27 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[47342e99-65f4-49d7-b724-82e2f836de7e]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:27 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d Nov 02 11:00:27 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:27 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d" returned: 0 in 0.352s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.01860e2f-13d9-4904-bb5e-f93727386df4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:27 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.01860e2f-13d9-4904-bb5e-f93727386df4 Nov 02 11:00:27 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:27 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.01860e2f-13d9-4904-bb5e-f93727386df4" returned: 0 in 0.375s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.01860e2f-13d9-4904-bb5e-f93727386df4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:27 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.01860e2f-13d9-4904-bb5e-f93727386df4 Nov 02 11:00:27 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:28 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d.01860e2f-13d9-4904-bb5e-f93727386df4" returned: 0 in 0.259s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-01860e2f-13d9-4904-bb5e-f93727386df4" released by "_delete_snapshot" :: held 1.502s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-dd570cff-2335-4e35-b4b9-debed0c1c78d" released by "delete_snapshot" :: held 1.529s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:28 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] Created reservations ['e18a44e6-b965-4df7-8467-5bb0abff130f', '8c2d844c-b39f-4e3c-a601-8d63f43f6395', 'fd85a28a-7af4-4738-9d33-5fc3f6072af7', '3f6fb1dc-c8a2-47b5-be04-3c3ca923c43b'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:28 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] Delete snapshot completed successfully. Nov 02 11:00:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f2a5dd21-4c2e-439c-97cd-60ed93faba59 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-01860e2f-13d9-4904-bb5e-f93727386df4-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ccbdd50c-c09b-4c53-91cd-5bc3326efb61 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-dd570cff-2335-4e35-b4b9-debed0c1c78d-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ccbdd50c-c09b-4c53-91cd-5bc3326efb61 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-dd570cff-2335-4e35-b4b9-debed0c1c78d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ccbdd50c-c09b-4c53-91cd-5bc3326efb61 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-dd570cff-2335-4e35-b4b9-debed0c1c78d" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ccbdd50c-c09b-4c53-91cd-5bc3326efb61 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-dd570cff-2335-4e35-b4b9-debed0c1c78d" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:28 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfdb8f1-fde5-4e87-b66e-3ed8306e7edc]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ccbdd50c-c09b-4c53-91cd-5bc3326efb61 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:28 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d Nov 02 11:00:28 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:29 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ccbdd50c-c09b-4c53-91cd-5bc3326efb61 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d" returned: 0 in 0.403s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ccbdd50c-c09b-4c53-91cd-5bc3326efb61 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:00:29 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d Nov 02 11:00:29 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Flow 'volume_create_manager' (7d33fab9-cfec-49ca-94f1-50e0985f54ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cad8dbe-b980-4f89-9b44-acc0816b9f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cad8dbe-b980-4f89-9b44-acc0816b9f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-474763183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9347c12-3933-4963-9baa-5fb2b730074e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f5e544a55e4ddfa493ad36283d087a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:29Z,use_quota=True,user_id='4e1ad237c0624f1e928bd867ef7db067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8278788-908c-4017-908b-73250d5eb7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8278788-908c-4017-908b-73250d5eb7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3314fddf-c6d9-4d20-aa76-7ead272c3486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3314fddf-c6d9-4d20-aa76-7ead272c3486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9347c12-3933-4963-9baa-5fb2b730074e', 'volume_name': 'volume-a9347c12-3933-4963-9baa-5fb2b730074e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75299fc0-6877-4a60-9e32-6f0282fb2109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75299fc0-6877-4a60-9e32-6f0282fb2109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d1fc6b-3e09-444b-8b0a-66f273d70c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:29 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Volume a9347c12-3933-4963-9baa-5fb2b730074e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9347c12-3933-4963-9baa-5fb2b730074e', 'volume_size': 1} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-474763183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9347c12-3933-4963-9baa-5fb2b730074e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f5e544a55e4ddfa493ad36283d087a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:29Z,use_quota=True,user_id='4e1ad237c0624f1e928bd867ef7db067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Creating volume a9347c12-3933-4963-9baa-5fb2b730074e {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:00:29 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a9347c12-3933-4963-9baa-5fb2b730074e 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:29 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a9347c12-3933-4963-9baa-5fb2b730074e 1073741824 Nov 02 11:00:29 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:29 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ccbdd50c-c09b-4c53-91cd-5bc3326efb61 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-dd570cff-2335-4e35-b4b9-debed0c1c78d" returned: 0 in 0.245s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ccbdd50c-c09b-4c53-91cd-5bc3326efb61 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-dd570cff-2335-4e35-b4b9-debed0c1c78d" released by "delete_volume" :: held 0.719s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-ccbdd50c-c09b-4c53-91cd-5bc3326efb61 tempest-ProjectMemberTests-1266221133 None] Created reservations ['7f400e16-91e7-4dea-bd05-b409f3df9b5f', 'be49c7e7-eeb6-4e81-b977-3b6d9b7c1fc1', '113d317a-41b5-4afd-bbe5-e7c0e643aabb', 'c54d9910-70c3-4b63-9ac5-2a4e0ac7513c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ccbdd50c-c09b-4c53-91cd-5bc3326efb61 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ccbdd50c-c09b-4c53-91cd-5bc3326efb61 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ccbdd50c-c09b-4c53-91cd-5bc3326efb61 tempest-ProjectMemberTests-1266221133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ccbdd50c-c09b-4c53-91cd-5bc3326efb61 tempest-ProjectMemberTests-1266221133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ccbdd50c-c09b-4c53-91cd-5bc3326efb61 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ccbdd50c-c09b-4c53-91cd-5bc3326efb61 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:29 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 11:00:29 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:29 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a9347c12-3933-4963-9baa-5fb2b730074e 1073741824" returned: 0 in 0.426s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a9347c12-3933-4963-9baa-5fb2b730074e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:29 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a9347c12-3933-4963-9baa-5fb2b730074e Nov 02 11:00:29 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:29 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ccbdd50c-c09b-4c53-91cd-5bc3326efb61 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.281s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-ccbdd50c-c09b-4c53-91cd-5bc3326efb61 tempest-ProjectMemberTests-1266221133 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ccbdd50c-c09b-4c53-91cd-5bc3326efb61 tempest-ProjectMemberTests-1266221133 None] Deleted volume successfully. Nov 02 11:00:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ccbdd50c-c09b-4c53-91cd-5bc3326efb61 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-dd570cff-2335-4e35-b4b9-debed0c1c78d-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:30 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a9347c12-3933-4963-9baa-5fb2b730074e" returned: 0 in 0.284s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d1fc6b-3e09-444b-8b0a-66f273d70c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9347c12-3933-4963-9baa-5fb2b730074e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7921298d-fccb-48c4-a0e5-f576bf2333fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:30 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Volume volume-a9347c12-3933-4963-9baa-5fb2b730074e (a9347c12-3933-4963-9baa-5fb2b730074e): created successfully Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7921298d-fccb-48c4-a0e5-f576bf2333fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Flow 'volume_create_manager' (7d33fab9-cfec-49ca-94f1-50e0985f54ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:30 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f4b9cbf0-3e28-4fa6-8e7c-b654d33caa66 tempest-ProjectReaderTests-192073576 None] Created volume successfully. Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Flow 'volume_create_manager' (f600c5cf-1926-4bb5-89a9-cd93b461d718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfbc34df-b874-4f1e-91a5-a5570cd7b441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfbc34df-b874-4f1e-91a5-a5570cd7b441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698013733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe0af7b8-06c2-4b56-95b9-f9905f7d79db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de43071a1c4348bf85c649c8f77ffcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:30Z,use_quota=True,user_id='eeeb85b0d7c743069682afbcc7ffccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36577f00-d716-4d1e-8dc9-2763edac7efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36577f00-d716-4d1e-8dc9-2763edac7efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a66b01-6b4f-4583-8cfb-2eac15e78211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a66b01-6b4f-4583-8cfb-2eac15e78211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe0af7b8-06c2-4b56-95b9-f9905f7d79db', 'volume_name': 'volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c4f49f-32b0-4720-a8ca-1c812276e12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c4f49f-32b0-4720-a8ca-1c812276e12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adff3b45-4095-45df-a1d5-92a35c28d264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:30 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Volume fe0af7b8-06c2-4b56-95b9-f9905f7d79db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db', 'volume_size': 1} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698013733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe0af7b8-06c2-4b56-95b9-f9905f7d79db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de43071a1c4348bf85c649c8f77ffcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:30Z,use_quota=True,user_id='eeeb85b0d7c743069682afbcc7ffccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Creating volume fe0af7b8-06c2-4b56-95b9-f9905f7d79db {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:00:30 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:30 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db 1073741824 Nov 02 11:00:30 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:30 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db 1073741824" returned: 0 in 0.414s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:30 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db Nov 02 11:00:30 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:31 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db" returned: 0 in 0.242s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:00:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adff3b45-4095-45df-a1d5-92a35c28d264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c9a28a-aa6a-45a3-9310-3ee67b3707e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:31 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Volume volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db (fe0af7b8-06c2-4b56-95b9-f9905f7d79db): created successfully Nov 02 11:00:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c9a28a-aa6a-45a3-9310-3ee67b3707e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Flow 'volume_create_manager' (f600c5cf-1926-4bb5-89a9-cd93b461d718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-81aff4d0-9836-4f9f-980a-93dbf02bc60f tempest-ProjectMemberTests-1266221133 None] Created volume successfully. Nov 02 11:00:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b3a9e06a-ddd4-4260-90c6-5c575566d469 tempest-ProjectReaderTests-192073576 None] Acquiring lock "cinder-a9347c12-3933-4963-9baa-5fb2b730074e-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b3a9e06a-ddd4-4260-90c6-5c575566d469 tempest-ProjectReaderTests-192073576 None] Lock "cinder-a9347c12-3933-4963-9baa-5fb2b730074e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b3a9e06a-ddd4-4260-90c6-5c575566d469 tempest-ProjectReaderTests-192073576 None] Acquiring lock "cinder-quobyte-a9347c12-3933-4963-9baa-5fb2b730074e" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b3a9e06a-ddd4-4260-90c6-5c575566d469 tempest-ProjectReaderTests-192073576 None] Lock "cinder-quobyte-a9347c12-3933-4963-9baa-5fb2b730074e" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dbf5cacb-f75c-483f-bc6b-e838602fbb6f tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dbf5cacb-f75c-483f-bc6b-e838602fbb6f tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:31 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eadea62-a2f1-48db-a127-9c4915b186c5]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b3a9e06a-ddd4-4260-90c6-5c575566d469 tempest-ProjectReaderTests-192073576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a9347c12-3933-4963-9baa-5fb2b730074e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-dbf5cacb-f75c-483f-bc6b-e838602fbb6f tempest-ProjectMemberTests-1266221133 None] Creating offline snapshot 18e9151e-adad-4d3f-b2ad-29a98384dd0f of volume fe0af7b8-06c2-4b56-95b9-f9905f7d79db {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:00:31 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a2c9a2-7a23-4b25-8d99-289d1c414c7c]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dbf5cacb-f75c-483f-bc6b-e838602fbb6f tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:31 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a9347c12-3933-4963-9baa-5fb2b730074e Nov 02 11:00:31 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:31 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db Nov 02 11:00:31 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:31 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b3a9e06a-ddd4-4260-90c6-5c575566d469 tempest-ProjectReaderTests-192073576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a9347c12-3933-4963-9baa-5fb2b730074e" returned: 0 in 0.384s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b3a9e06a-ddd4-4260-90c6-5c575566d469 tempest-ProjectReaderTests-192073576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a9347c12-3933-4963-9baa-5fb2b730074e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:31 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a9347c12-3933-4963-9baa-5fb2b730074e Nov 02 11:00:31 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:32 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dbf5cacb-f75c-483f-bc6b-e838602fbb6f tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db" returned: 0 in 0.370s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dbf5cacb-f75c-483f-bc6b-e838602fbb6f tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.18e9151e-adad-4d3f-b2ad-29a98384dd0f 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:32 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.18e9151e-adad-4d3f-b2ad-29a98384dd0f 1G Nov 02 11:00:32 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:32 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b3a9e06a-ddd4-4260-90c6-5c575566d469 tempest-ProjectReaderTests-192073576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a9347c12-3933-4963-9baa-5fb2b730074e" returned: 0 in 0.254s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b3a9e06a-ddd4-4260-90c6-5c575566d469 tempest-ProjectReaderTests-192073576 None] Lock "cinder-quobyte-a9347c12-3933-4963-9baa-5fb2b730074e" released by "delete_volume" :: held 0.687s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:32 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-b3a9e06a-ddd4-4260-90c6-5c575566d469 tempest-ProjectReaderTests-192073576 None] Created reservations ['9660e190-be50-4d91-88f7-9b1c86ed4bda', '996bb4ba-988a-4e0f-8f76-75dc05ac25ec', 'd2201685-e7fe-4aa1-8f8f-29b0c3b24caa', '07465fef-fe09-4a3b-b798-803ad715831c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b3a9e06a-ddd4-4260-90c6-5c575566d469 tempest-ProjectReaderTests-192073576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b3a9e06a-ddd4-4260-90c6-5c575566d469 tempest-ProjectReaderTests-192073576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b3a9e06a-ddd4-4260-90c6-5c575566d469 tempest-ProjectReaderTests-192073576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b3a9e06a-ddd4-4260-90c6-5c575566d469 tempest-ProjectReaderTests-192073576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b3a9e06a-ddd4-4260-90c6-5c575566d469 tempest-ProjectReaderTests-192073576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b3a9e06a-ddd4-4260-90c6-5c575566d469 tempest-ProjectReaderTests-192073576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:32 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 11:00:32 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:32 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dbf5cacb-f75c-483f-bc6b-e838602fbb6f tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.18e9151e-adad-4d3f-b2ad-29a98384dd0f 1G" returned: 0 in 0.433s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dbf5cacb-f75c-483f-bc6b-e838602fbb6f tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.18e9151e-adad-4d3f-b2ad-29a98384dd0f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:32 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.18e9151e-adad-4d3f-b2ad-29a98384dd0f Nov 02 11:00:32 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:32 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b3a9e06a-ddd4-4260-90c6-5c575566d469 tempest-ProjectReaderTests-192073576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.263s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:32 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b3a9e06a-ddd4-4260-90c6-5c575566d469 tempest-ProjectReaderTests-192073576 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:32 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b3a9e06a-ddd4-4260-90c6-5c575566d469 tempest-ProjectReaderTests-192073576 None] Deleted volume successfully. Nov 02 11:00:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b3a9e06a-ddd4-4260-90c6-5c575566d469 tempest-ProjectReaderTests-192073576 None] Lock "cinder-a9347c12-3933-4963-9baa-5fb2b730074e-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:32 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dbf5cacb-f75c-483f-bc6b-e838602fbb6f tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.18e9151e-adad-4d3f-b2ad-29a98384dd0f" returned: 0 in 0.306s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:32 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-dbf5cacb-f75c-483f-bc6b-e838602fbb6f tempest-ProjectMemberTests-1266221133 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.18e9151e-adad-4d3f-b2ad-29a98384dd0f is being set with open permissions: ugo+rw Nov 02 11:00:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dbf5cacb-f75c-483f-bc6b-e838602fbb6f tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.18e9151e-adad-4d3f-b2ad-29a98384dd0f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:32 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.18e9151e-adad-4d3f-b2ad-29a98384dd0f Nov 02 11:00:32 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:33 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dbf5cacb-f75c-483f-bc6b-e838602fbb6f tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.18e9151e-adad-4d3f-b2ad-29a98384dd0f" returned: 0 in 0.264s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dbf5cacb-f75c-483f-bc6b-e838602fbb6f tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:33 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.info Nov 02 11:00:33 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Flow 'volume_create_manager' (4add46b1-cb03-43e3-b495-b85fd552a6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974086ea-2de9-4c1c-a4b9-96379658aad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974086ea-2de9-4c1c-a4b9-96379658aad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1532214925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fcc25d-88ad-4549-856c-3128daa9637d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f5e544a55e4ddfa493ad36283d087a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:33Z,use_quota=True,user_id='4e1ad237c0624f1e928bd867ef7db067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae3d346-e359-4287-af01-894d312f1770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae3d346-e359-4287-af01-894d312f1770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86800412-4b9a-4ca4-95e8-94299fa85915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86800412-4b9a-4ca4-95e8-94299fa85915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5fcc25d-88ad-4549-856c-3128daa9637d', 'volume_name': 'volume-a5fcc25d-88ad-4549-856c-3128daa9637d', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0213c84a-d7fb-44d6-933b-c3743ba00ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0213c84a-d7fb-44d6-933b-c3743ba00ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c01a815-55f8-4aee-9a58-c6e62700ef71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:33 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Volume a5fcc25d-88ad-4549-856c-3128daa9637d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5fcc25d-88ad-4549-856c-3128daa9637d', 'volume_size': 1} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:33 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dbf5cacb-f75c-483f-bc6b-e838602fbb6f tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.info" returned: 0 in 0.258s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:33 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-dbf5cacb-f75c-483f-bc6b-e838602fbb6f tempest-ProjectMemberTests-1266221133 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.info is being set with open permissions: ugo+rw Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dbf5cacb-f75c-483f-bc6b-e838602fbb6f tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:33 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.info Nov 02 11:00:33 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:33 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dbf5cacb-f75c-483f-bc6b-e838602fbb6f tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.info" returned: 0 in 0.239s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dbf5cacb-f75c-483f-bc6b-e838602fbb6f tempest-ProjectMemberTests-1266221133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.975s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.378s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1532214925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fcc25d-88ad-4549-856c-3128daa9637d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f5e544a55e4ddfa493ad36283d087a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:33Z,use_quota=True,user_id='4e1ad237c0624f1e928bd867ef7db067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Creating volume a5fcc25d-88ad-4549-856c-3128daa9637d {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:00:33 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a5fcc25d-88ad-4549-856c-3128daa9637d 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:33 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a5fcc25d-88ad-4549-856c-3128daa9637d 1073741824 Nov 02 11:00:33 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-dbf5cacb-f75c-483f-bc6b-e838602fbb6f tempest-ProjectMemberTests-1266221133 None] Create snapshot completed successfully Nov 02 11:00:33 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a5fcc25d-88ad-4549-856c-3128daa9637d 1073741824" returned: 0 in 0.415s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a5fcc25d-88ad-4549-856c-3128daa9637d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:34 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a5fcc25d-88ad-4549-856c-3128daa9637d Nov 02 11:00:34 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:34 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a5fcc25d-88ad-4549-856c-3128daa9637d" returned: 0 in 0.240s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:00:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c01a815-55f8-4aee-9a58-c6e62700ef71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5fcc25d-88ad-4549-856c-3128daa9637d', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45aeddcc-4d53-40f5-8f56-ff16a7ab8ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:34 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Volume volume-a5fcc25d-88ad-4549-856c-3128daa9637d (a5fcc25d-88ad-4549-856c-3128daa9637d): created successfully Nov 02 11:00:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45aeddcc-4d53-40f5-8f56-ff16a7ab8ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Flow 'volume_create_manager' (4add46b1-cb03-43e3-b495-b85fd552a6aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6769762c-e694-454d-9115-5c5ad4c1b81d tempest-ProjectReaderTests-192073576 None] Created volume successfully. Nov 02 11:00:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-18e9151e-adad-4d3f-b2ad-29a98384dd0f-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-18e9151e-adad-4d3f-b2ad-29a98384dd0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-fe0af7b8-06c2-4b56-95b9-f9905f7d79db" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-fe0af7b8-06c2-4b56-95b9-f9905f7d79db" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-18e9151e-adad-4d3f-b2ad-29a98384dd0f" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-18e9151e-adad-4d3f-b2ad-29a98384dd0f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] Deleting offline snapshot 18e9151e-adad-4d3f-b2ad-29a98384dd0f of volume fe0af7b8-06c2-4b56-95b9-f9905f7d79db {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:00:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] snapshot_file for this snap is: volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.18e9151e-adad-4d3f-b2ad-29a98384dd0f {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:00:34 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[606aac04-ee3e-4a0f-8f05-e0abcbca2500]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.18e9151e-adad-4d3f-b2ad-29a98384dd0f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:34 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.18e9151e-adad-4d3f-b2ad-29a98384dd0f Nov 02 11:00:34 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0ae944ac-1d17-4623-b5ea-8259ded34747 tempest-ProjectReaderTests-192073576 None] Acquiring lock "cinder-a5fcc25d-88ad-4549-856c-3128daa9637d-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:35 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0ae944ac-1d17-4623-b5ea-8259ded34747 tempest-ProjectReaderTests-192073576 None] Lock "cinder-a5fcc25d-88ad-4549-856c-3128daa9637d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:35 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=197,cinder:INSERT=72,cinder:UPDATE=262,cinder:DELETE=22 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:00:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.18e9151e-adad-4d3f-b2ad-29a98384dd0f" returned: 0 in 0.368s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:00:35 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=187,cinder:INSERT=66,cinder:UPDATE=244,cinder:DELETE=20 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:00:35 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c6d09a-ee66-410f-9c61-e852e275fafd]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0ae944ac-1d17-4623-b5ea-8259ded34747 tempest-ProjectReaderTests-192073576 None] Acquiring lock "cinder-quobyte-a5fcc25d-88ad-4549-856c-3128daa9637d" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0ae944ac-1d17-4623-b5ea-8259ded34747 tempest-ProjectReaderTests-192073576 None] Lock "cinder-quobyte-a5fcc25d-88ad-4549-856c-3128daa9637d" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:35 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc237bf-e464-4d02-88a1-be9547bd0b6f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0ae944ac-1d17-4623-b5ea-8259ded34747 tempest-ProjectReaderTests-192073576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a5fcc25d-88ad-4549-856c-3128daa9637d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:35 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db Nov 02 11:00:35 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:35 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a5fcc25d-88ad-4549-856c-3128daa9637d Nov 02 11:00:35 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:35 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db" returned: 0 in 0.380s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.18e9151e-adad-4d3f-b2ad-29a98384dd0f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:35 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.18e9151e-adad-4d3f-b2ad-29a98384dd0f Nov 02 11:00:35 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:35 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0ae944ac-1d17-4623-b5ea-8259ded34747 tempest-ProjectReaderTests-192073576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a5fcc25d-88ad-4549-856c-3128daa9637d" returned: 0 in 0.375s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0ae944ac-1d17-4623-b5ea-8259ded34747 tempest-ProjectReaderTests-192073576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a5fcc25d-88ad-4549-856c-3128daa9637d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:35 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a5fcc25d-88ad-4549-856c-3128daa9637d Nov 02 11:00:35 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:36 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0ae944ac-1d17-4623-b5ea-8259ded34747 tempest-ProjectReaderTests-192073576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a5fcc25d-88ad-4549-856c-3128daa9637d" returned: 0 in 0.259s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0ae944ac-1d17-4623-b5ea-8259ded34747 tempest-ProjectReaderTests-192073576 None] Lock "cinder-quobyte-a5fcc25d-88ad-4549-856c-3128daa9637d" released by "delete_volume" :: held 0.679s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:36 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.18e9151e-adad-4d3f-b2ad-29a98384dd0f" returned: 0 in 0.356s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.18e9151e-adad-4d3f-b2ad-29a98384dd0f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:36 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.18e9151e-adad-4d3f-b2ad-29a98384dd0f Nov 02 11:00:36 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-0ae944ac-1d17-4623-b5ea-8259ded34747 tempest-ProjectReaderTests-192073576 None] Created reservations ['fd9db2bf-dab6-4d88-9b26-f7a12eee2b88', '745736f6-a91c-470e-8093-72da144ebc0b', '592bb6da-5646-4ecf-9d2f-d12aeea298dc', '23985377-63b4-4c03-8e1d-e1791bcfa37f'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0ae944ac-1d17-4623-b5ea-8259ded34747 tempest-ProjectReaderTests-192073576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0ae944ac-1d17-4623-b5ea-8259ded34747 tempest-ProjectReaderTests-192073576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0ae944ac-1d17-4623-b5ea-8259ded34747 tempest-ProjectReaderTests-192073576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0ae944ac-1d17-4623-b5ea-8259ded34747 tempest-ProjectReaderTests-192073576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0ae944ac-1d17-4623-b5ea-8259ded34747 tempest-ProjectReaderTests-192073576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0ae944ac-1d17-4623-b5ea-8259ded34747 tempest-ProjectReaderTests-192073576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:36 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 11:00:36 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:36 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db.18e9151e-adad-4d3f-b2ad-29a98384dd0f" returned: 0 in 0.267s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-18e9151e-adad-4d3f-b2ad-29a98384dd0f" released by "_delete_snapshot" :: held 1.494s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-fe0af7b8-06c2-4b56-95b9-f9905f7d79db" released by "delete_snapshot" :: held 1.520s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] Created reservations ['074bed3d-7905-442b-9fab-59b548b90770', '79fd4fec-52dc-4a5e-8fb9-64c3906473f8', '44e78933-5d15-4ef5-ba5b-8439f6eea469', '3bc8d466-998d-453c-a622-a67b977bc9d4'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:36 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0ae944ac-1d17-4623-b5ea-8259ded34747 tempest-ProjectReaderTests-192073576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.284s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-0ae944ac-1d17-4623-b5ea-8259ded34747 tempest-ProjectReaderTests-192073576 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:36 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0ae944ac-1d17-4623-b5ea-8259ded34747 tempest-ProjectReaderTests-192073576 None] Deleted volume successfully. Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0ae944ac-1d17-4623-b5ea-8259ded34747 tempest-ProjectReaderTests-192073576 None] Lock "cinder-a5fcc25d-88ad-4549-856c-3128daa9637d-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:36 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] Delete snapshot completed successfully. Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-940d285e-9f8f-4265-9476-09390d458f31 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-18e9151e-adad-4d3f-b2ad-29a98384dd0f-delete_snapshot" released by "delete_snapshot" :: held 1.688s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Flow 'volume_create_manager' (95327e6e-dbac-4733-9e86-ff041ec3d9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c902bdb1-1aea-49d3-9661-c01cb733f597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c902bdb1-1aea-49d3-9661-c01cb733f597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2017330575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfc006b-90a0-4abd-85d6-890878797432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f5e544a55e4ddfa493ad36283d087a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:37Z,use_quota=True,user_id='4e1ad237c0624f1e928bd867ef7db067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6fd0d4-b0ca-4b2b-818e-c92604f53bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6fd0d4-b0ca-4b2b-818e-c92604f53bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76983ed4-33bc-4ac2-9285-c73879c25b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76983ed4-33bc-4ac2-9285-c73879c25b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebfc006b-90a0-4abd-85d6-890878797432', 'volume_name': 'volume-ebfc006b-90a0-4abd-85d6-890878797432', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f70feba-917f-4d12-86ee-1dff4b98d001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f70feba-917f-4d12-86ee-1dff4b98d001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0405f1d-8f4f-4cf8-93b5-f49be2c09e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:36 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Volume ebfc006b-90a0-4abd-85d6-890878797432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebfc006b-90a0-4abd-85d6-890878797432', 'volume_size': 1} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2017330575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfc006b-90a0-4abd-85d6-890878797432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f5e544a55e4ddfa493ad36283d087a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:37Z,use_quota=True,user_id='4e1ad237c0624f1e928bd867ef7db067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Creating volume ebfc006b-90a0-4abd-85d6-890878797432 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:00:36 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ebfc006b-90a0-4abd-85d6-890878797432 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:36 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ebfc006b-90a0-4abd-85d6-890878797432 1073741824 Nov 02 11:00:36 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abbd41b1-579a-4595-8605-61f043654331 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-fe0af7b8-06c2-4b56-95b9-f9905f7d79db-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abbd41b1-579a-4595-8605-61f043654331 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-fe0af7b8-06c2-4b56-95b9-f9905f7d79db-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abbd41b1-579a-4595-8605-61f043654331 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "cinder-quobyte-fe0af7b8-06c2-4b56-95b9-f9905f7d79db" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abbd41b1-579a-4595-8605-61f043654331 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-fe0af7b8-06c2-4b56-95b9-f9905f7d79db" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c6817c-a922-4fa8-bf68-e06a63cd2b61]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abbd41b1-579a-4595-8605-61f043654331 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:37 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db Nov 02 11:00:37 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:37 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ebfc006b-90a0-4abd-85d6-890878797432 1073741824" returned: 0 in 0.446s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ebfc006b-90a0-4abd-85d6-890878797432 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:37 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ebfc006b-90a0-4abd-85d6-890878797432 Nov 02 11:00:37 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:37 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abbd41b1-579a-4595-8605-61f043654331 tempest-ProjectMemberTests-1266221133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db" returned: 0 in 0.394s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abbd41b1-579a-4595-8605-61f043654331 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:37 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db Nov 02 11:00:37 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:37 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ebfc006b-90a0-4abd-85d6-890878797432" returned: 0 in 0.250s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0405f1d-8f4f-4cf8-93b5-f49be2c09e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebfc006b-90a0-4abd-85d6-890878797432', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32589d3c-639c-4197-af5a-30e4f7b196d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:37 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Volume volume-ebfc006b-90a0-4abd-85d6-890878797432 (ebfc006b-90a0-4abd-85d6-890878797432): created successfully Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32589d3c-639c-4197-af5a-30e4f7b196d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Flow 'volume_create_manager' (95327e6e-dbac-4733-9e86-ff041ec3d9d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6ad8f03c-c451-4a4b-909c-562da6bd5fae tempest-ProjectReaderTests-192073576 None] Created volume successfully. Nov 02 11:00:37 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abbd41b1-579a-4595-8605-61f043654331 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-fe0af7b8-06c2-4b56-95b9-f9905f7d79db" returned: 0 in 0.268s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abbd41b1-579a-4595-8605-61f043654331 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-quobyte-fe0af7b8-06c2-4b56-95b9-f9905f7d79db" released by "delete_volume" :: held 0.726s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-abbd41b1-579a-4595-8605-61f043654331 tempest-ProjectMemberTests-1266221133 None] Created reservations ['0ef58f1a-bc47-4e01-b0bc-8ba1e5f5f30a', '938d6000-34f9-4ce0-94bf-54da601c6e71', '00ea139d-521e-4cfc-9593-60bea86360f4', '0f68be83-61c2-400b-a23e-b77394ceb8b3'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-abbd41b1-579a-4595-8605-61f043654331 tempest-ProjectMemberTests-1266221133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-abbd41b1-579a-4595-8605-61f043654331 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-abbd41b1-579a-4595-8605-61f043654331 tempest-ProjectMemberTests-1266221133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-abbd41b1-579a-4595-8605-61f043654331 tempest-ProjectMemberTests-1266221133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-abbd41b1-579a-4595-8605-61f043654331 tempest-ProjectMemberTests-1266221133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abbd41b1-579a-4595-8605-61f043654331 tempest-ProjectMemberTests-1266221133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:37 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 11:00:37 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e1a4d2ec-4fd5-44f3-8682-46c84934506d tempest-ProjectReaderTests-192073576 None] Acquiring lock "cinder-ebfc006b-90a0-4abd-85d6-890878797432-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e1a4d2ec-4fd5-44f3-8682-46c84934506d tempest-ProjectReaderTests-192073576 None] Lock "cinder-ebfc006b-90a0-4abd-85d6-890878797432-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e1a4d2ec-4fd5-44f3-8682-46c84934506d tempest-ProjectReaderTests-192073576 None] Acquiring lock "cinder-quobyte-ebfc006b-90a0-4abd-85d6-890878797432" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e1a4d2ec-4fd5-44f3-8682-46c84934506d tempest-ProjectReaderTests-192073576 None] Lock "cinder-quobyte-ebfc006b-90a0-4abd-85d6-890878797432" acquired by "delete_volume" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:38 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7f6eaa-800e-4bd5-a007-09442cd573c5]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e1a4d2ec-4fd5-44f3-8682-46c84934506d tempest-ProjectReaderTests-192073576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ebfc006b-90a0-4abd-85d6-890878797432 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:38 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ebfc006b-90a0-4abd-85d6-890878797432 Nov 02 11:00:38 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:38 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abbd41b1-579a-4595-8605-61f043654331 tempest-ProjectMemberTests-1266221133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.290s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:38 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-abbd41b1-579a-4595-8605-61f043654331 tempest-ProjectMemberTests-1266221133 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:38 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-abbd41b1-579a-4595-8605-61f043654331 tempest-ProjectMemberTests-1266221133 None] Deleted volume successfully. Nov 02 11:00:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abbd41b1-579a-4595-8605-61f043654331 tempest-ProjectMemberTests-1266221133 None] Lock "cinder-fe0af7b8-06c2-4b56-95b9-f9905f7d79db-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:38 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e1a4d2ec-4fd5-44f3-8682-46c84934506d tempest-ProjectReaderTests-192073576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ebfc006b-90a0-4abd-85d6-890878797432" returned: 0 in 0.392s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e1a4d2ec-4fd5-44f3-8682-46c84934506d tempest-ProjectReaderTests-192073576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ebfc006b-90a0-4abd-85d6-890878797432 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:38 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ebfc006b-90a0-4abd-85d6-890878797432 Nov 02 11:00:38 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:38 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e1a4d2ec-4fd5-44f3-8682-46c84934506d tempest-ProjectReaderTests-192073576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-ebfc006b-90a0-4abd-85d6-890878797432" returned: 0 in 0.265s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e1a4d2ec-4fd5-44f3-8682-46c84934506d tempest-ProjectReaderTests-192073576 None] Lock "cinder-quobyte-ebfc006b-90a0-4abd-85d6-890878797432" released by "delete_volume" :: held 0.702s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:38 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-e1a4d2ec-4fd5-44f3-8682-46c84934506d tempest-ProjectReaderTests-192073576 None] Created reservations ['c9c56968-1484-46c4-b65f-0ab179422a94', '6dfdfc90-6ecb-48d5-88d1-4c994ab100c8', '42999be1-a238-4a82-8d07-a62b2e7a858e', 'de233da4-11a7-447f-99dd-492b8b15a588'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e1a4d2ec-4fd5-44f3-8682-46c84934506d tempest-ProjectReaderTests-192073576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e1a4d2ec-4fd5-44f3-8682-46c84934506d tempest-ProjectReaderTests-192073576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e1a4d2ec-4fd5-44f3-8682-46c84934506d tempest-ProjectReaderTests-192073576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e1a4d2ec-4fd5-44f3-8682-46c84934506d tempest-ProjectReaderTests-192073576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e1a4d2ec-4fd5-44f3-8682-46c84934506d tempest-ProjectReaderTests-192073576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e1a4d2ec-4fd5-44f3-8682-46c84934506d tempest-ProjectReaderTests-192073576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:38 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 11:00:38 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:39 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e1a4d2ec-4fd5-44f3-8682-46c84934506d tempest-ProjectReaderTests-192073576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.319s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-e1a4d2ec-4fd5-44f3-8682-46c84934506d tempest-ProjectReaderTests-192073576 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:39 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e1a4d2ec-4fd5-44f3-8682-46c84934506d tempest-ProjectReaderTests-192073576 None] Deleted volume successfully. Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e1a4d2ec-4fd5-44f3-8682-46c84934506d tempest-ProjectReaderTests-192073576 None] Lock "cinder-ebfc006b-90a0-4abd-85d6-890878797432-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Flow 'volume_create_manager' (ca0642c4-8b93-48c6-bb36-dc2eaf925d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f900dfd0-7970-4cc5-8d50-bb2ed83014c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f900dfd0-7970-4cc5-8d50-bb2ed83014c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1290613997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3107648-5f66-40e2-a0bc-5dd9a4a05e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f5e544a55e4ddfa493ad36283d087a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:40Z,use_quota=True,user_id='4e1ad237c0624f1e928bd867ef7db067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d957101-e464-4603-bbf1-44265f94c35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d957101-e464-4603-bbf1-44265f94c35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f521279a-999d-4c27-a295-ea7596038a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f521279a-999d-4c27-a295-ea7596038a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3107648-5f66-40e2-a0bc-5dd9a4a05e29', 'volume_name': 'volume-a3107648-5f66-40e2-a0bc-5dd9a4a05e29', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdf4103-f81d-4859-b304-14d1fd8612f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdf4103-f81d-4859-b304-14d1fd8612f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e667b10e-3da3-4bb8-a61f-5de35fbc2419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Volume a3107648-5f66-40e2-a0bc-5dd9a4a05e29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3107648-5f66-40e2-a0bc-5dd9a4a05e29', 'volume_size': 1} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1290613997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3107648-5f66-40e2-a0bc-5dd9a4a05e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f5e544a55e4ddfa493ad36283d087a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:40Z,use_quota=True,user_id='4e1ad237c0624f1e928bd867ef7db067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Creating volume a3107648-5f66-40e2-a0bc-5dd9a4a05e29 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:00:39 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 11:00:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3107648-5f66-40e2-a0bc-5dd9a4a05e29 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:39 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3107648-5f66-40e2-a0bc-5dd9a4a05e29 1073741824 Nov 02 11:00:39 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:40 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3107648-5f66-40e2-a0bc-5dd9a4a05e29 1073741824" returned: 0 in 0.433s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3107648-5f66-40e2-a0bc-5dd9a4a05e29 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:40 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3107648-5f66-40e2-a0bc-5dd9a4a05e29 Nov 02 11:00:40 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:40 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3107648-5f66-40e2-a0bc-5dd9a4a05e29" returned: 0 in 0.249s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:00:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e667b10e-3da3-4bb8-a61f-5de35fbc2419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3107648-5f66-40e2-a0bc-5dd9a4a05e29', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca7fa247-4f5e-4fbe-bfd6-1ecc05f06e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:40 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Volume volume-a3107648-5f66-40e2-a0bc-5dd9a4a05e29 (a3107648-5f66-40e2-a0bc-5dd9a4a05e29): created successfully Nov 02 11:00:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca7fa247-4f5e-4fbe-bfd6-1ecc05f06e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Flow 'volume_create_manager' (ca0642c4-8b93-48c6-bb36-dc2eaf925d4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:40 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c6b933a9-61dd-4d8d-b063-7914d1db1227 tempest-ProjectReaderTests-192073576 None] Created volume successfully. Nov 02 11:00:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d1f292db-6739-4f33-916c-824c73ef8ba1 tempest-ProjectReaderTests-192073576 None] Acquiring lock "cinder-a3107648-5f66-40e2-a0bc-5dd9a4a05e29-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d1f292db-6739-4f33-916c-824c73ef8ba1 tempest-ProjectReaderTests-192073576 None] Lock "cinder-a3107648-5f66-40e2-a0bc-5dd9a4a05e29-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d1f292db-6739-4f33-916c-824c73ef8ba1 tempest-ProjectReaderTests-192073576 None] Acquiring lock "cinder-quobyte-a3107648-5f66-40e2-a0bc-5dd9a4a05e29" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d1f292db-6739-4f33-916c-824c73ef8ba1 tempest-ProjectReaderTests-192073576 None] Lock "cinder-quobyte-a3107648-5f66-40e2-a0bc-5dd9a4a05e29" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:40 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3ab54c-1638-4dcb-b806-040ff90200d2]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1f292db-6739-4f33-916c-824c73ef8ba1 tempest-ProjectReaderTests-192073576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3107648-5f66-40e2-a0bc-5dd9a4a05e29 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:40 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3107648-5f66-40e2-a0bc-5dd9a4a05e29 Nov 02 11:00:40 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:41 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1f292db-6739-4f33-916c-824c73ef8ba1 tempest-ProjectReaderTests-192073576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3107648-5f66-40e2-a0bc-5dd9a4a05e29" returned: 0 in 0.392s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1f292db-6739-4f33-916c-824c73ef8ba1 tempest-ProjectReaderTests-192073576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3107648-5f66-40e2-a0bc-5dd9a4a05e29 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:41 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3107648-5f66-40e2-a0bc-5dd9a4a05e29 Nov 02 11:00:41 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:41 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1f292db-6739-4f33-916c-824c73ef8ba1 tempest-ProjectReaderTests-192073576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-a3107648-5f66-40e2-a0bc-5dd9a4a05e29" returned: 0 in 0.273s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d1f292db-6739-4f33-916c-824c73ef8ba1 tempest-ProjectReaderTests-192073576 None] Lock "cinder-quobyte-a3107648-5f66-40e2-a0bc-5dd9a4a05e29" released by "delete_volume" :: held 0.721s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:41 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-d1f292db-6739-4f33-916c-824c73ef8ba1 tempest-ProjectReaderTests-192073576 None] Created reservations ['a22a441b-cf17-4db4-a547-074719f07a2c', 'd2a0df71-9c1e-44a8-9c53-dbfc1fae1105', 'ee903bf2-3273-4f8b-8553-4a29b5d7f1a4', '363e0ac2-74fc-4301-946a-cac89f0f2db8'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d1f292db-6739-4f33-916c-824c73ef8ba1 tempest-ProjectReaderTests-192073576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d1f292db-6739-4f33-916c-824c73ef8ba1 tempest-ProjectReaderTests-192073576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d1f292db-6739-4f33-916c-824c73ef8ba1 tempest-ProjectReaderTests-192073576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d1f292db-6739-4f33-916c-824c73ef8ba1 tempest-ProjectReaderTests-192073576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d1f292db-6739-4f33-916c-824c73ef8ba1 tempest-ProjectReaderTests-192073576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1f292db-6739-4f33-916c-824c73ef8ba1 tempest-ProjectReaderTests-192073576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:41 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 11:00:41 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:41 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d1f292db-6739-4f33-916c-824c73ef8ba1 tempest-ProjectReaderTests-192073576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.301s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:41 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-d1f292db-6739-4f33-916c-824c73ef8ba1 tempest-ProjectReaderTests-192073576 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d1f292db-6739-4f33-916c-824c73ef8ba1 tempest-ProjectReaderTests-192073576 None] Deleted volume successfully. Nov 02 11:00:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d1f292db-6739-4f33-916c-824c73ef8ba1 tempest-ProjectReaderTests-192073576 None] Lock "cinder-a3107648-5f66-40e2-a0bc-5dd9a4a05e29-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:00:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:53 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 11:00:53 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:53 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.295s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:00:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:00:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:00:56 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=28,cinder:INSERT=11,cinder:UPDATE=40,cinder:DELETE=3 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:00:56 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=29,cinder:INSERT=11,cinder:UPDATE=47,cinder:DELETE=3 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Flow 'volume_create_manager' (adabfa1b-2f8f-4198-8abf-17d1a4da8ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015249bc-c6b6-42f8-8159-2b7d861fc3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015249bc-c6b6-42f8-8159-2b7d861fc3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-326494936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9911db51-8ab6-4874-9b98-bcdced1186db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac80abadaedd42969bd89cd11b8f0d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:01Z,use_quota=True,user_id='396fc913bbd44b3fade42c98b5bb9619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8482c38-26aa-4ce6-b84b-89a828c3033a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8482c38-26aa-4ce6-b84b-89a828c3033a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (082384bd-783b-482a-8686-ae53e1af4183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (082384bd-783b-482a-8686-ae53e1af4183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9911db51-8ab6-4874-9b98-bcdced1186db', 'volume_name': 'volume-9911db51-8ab6-4874-9b98-bcdced1186db', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3c0b62-5811-40f3-8e3b-b75d6d0117bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3c0b62-5811-40f3-8e3b-b75d6d0117bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977f3b41-889a-43bb-80ed-8a2fa4872cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:00 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Volume 9911db51-8ab6-4874-9b98-bcdced1186db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9911db51-8ab6-4874-9b98-bcdced1186db', 'volume_size': 1} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-326494936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9911db51-8ab6-4874-9b98-bcdced1186db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac80abadaedd42969bd89cd11b8f0d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:01Z,use_quota=True,user_id='396fc913bbd44b3fade42c98b5bb9619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Creating volume 9911db51-8ab6-4874-9b98-bcdced1186db {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:01:00 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] casted to osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 Nov 02 11:01:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:00 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db 1073741824 Nov 02 11:01:00 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:01 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db 1073741824" returned: 0 in 0.413s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:01 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db Nov 02 11:01:01 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:01 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db" returned: 0 in 0.245s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:01:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977f3b41-889a-43bb-80ed-8a2fa4872cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9911db51-8ab6-4874-9b98-bcdced1186db', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4363f9-69e7-4a08-8cf5-38b34eb441cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:01 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Volume volume-9911db51-8ab6-4874-9b98-bcdced1186db (9911db51-8ab6-4874-9b98-bcdced1186db): created successfully Nov 02 11:01:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4363f9-69e7-4a08-8cf5-38b34eb441cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Flow 'volume_create_manager' (adabfa1b-2f8f-4198-8abf-17d1a4da8ee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:01 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-36792592-a96b-44d8-b06e-96f285c409d9 tempest-SnapshotDependencyTests-1889918259 None] Created volume successfully. Nov 02 11:01:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cd792840-4868-4553-9725-1084c6ff591d tempest-SnapshotDependencyTests-1889918259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cd792840-4868-4553-9725-1084c6ff591d tempest-SnapshotDependencyTests-1889918259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-cd792840-4868-4553-9725-1084c6ff591d tempest-SnapshotDependencyTests-1889918259 None] Creating offline snapshot 0fab7c3a-860d-47ca-9948-515abb7a8a75 of volume 9911db51-8ab6-4874-9b98-bcdced1186db {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:01:02 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2e2f41-0060-4787-bc48-164bf4776998]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cd792840-4868-4553-9725-1084c6ff591d tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:02 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db Nov 02 11:01:02 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:02 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cd792840-4868-4553-9725-1084c6ff591d tempest-SnapshotDependencyTests-1889918259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db" returned: 0 in 0.357s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cd792840-4868-4553-9725-1084c6ff591d tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:02 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75 1G Nov 02 11:01:02 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:02 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cd792840-4868-4553-9725-1084c6ff591d tempest-SnapshotDependencyTests-1889918259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75 1G" returned: 0 in 0.381s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cd792840-4868-4553-9725-1084c6ff591d tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9911db51-8ab6-4874-9b98-bcdced1186db -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:02 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9911db51-8ab6-4874-9b98-bcdced1186db -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75 Nov 02 11:01:02 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:03 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cd792840-4868-4553-9725-1084c6ff591d tempest-SnapshotDependencyTests-1889918259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9911db51-8ab6-4874-9b98-bcdced1186db -F qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75" returned: 0 in 0.291s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:03 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-cd792840-4868-4553-9725-1084c6ff591d tempest-SnapshotDependencyTests-1889918259 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75 is being set with open permissions: ugo+rw Nov 02 11:01:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cd792840-4868-4553-9725-1084c6ff591d tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:03 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75 Nov 02 11:01:03 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:03 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cd792840-4868-4553-9725-1084c6ff591d tempest-SnapshotDependencyTests-1889918259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75" returned: 0 in 0.261s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cd792840-4868-4553-9725-1084c6ff591d tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:03 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.info Nov 02 11:01:03 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:03 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cd792840-4868-4553-9725-1084c6ff591d tempest-SnapshotDependencyTests-1889918259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.info" returned: 0 in 0.248s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:03 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-cd792840-4868-4553-9725-1084c6ff591d tempest-SnapshotDependencyTests-1889918259 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.info is being set with open permissions: ugo+rw Nov 02 11:01:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cd792840-4868-4553-9725-1084c6ff591d tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:03 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.info Nov 02 11:01:03 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:03 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cd792840-4868-4553-9725-1084c6ff591d tempest-SnapshotDependencyTests-1889918259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.info" returned: 0 in 0.245s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cd792840-4868-4553-9725-1084c6ff591d tempest-SnapshotDependencyTests-1889918259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.883s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-cd792840-4868-4553-9725-1084c6ff591d tempest-SnapshotDependencyTests-1889918259 None] Create snapshot completed successfully Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Flow 'volume_create_manager' (accbdf4b-2ef1-4810-93b6-fec7a9af7100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e11de04-5c02-432c-9694-96b8dc457976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e11de04-5c02-432c-9694-96b8dc457976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de479b8-b93c-4c24-bcd8-a8ac467f6018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac80abadaedd42969bd89cd11b8f0d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0fab7c3a-860d-47ca-9948-515abb7a8a75,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:05Z,use_quota=True,user_id='396fc913bbd44b3fade42c98b5bb9619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(954d2648-ae9c-4def-98a7-fb4522790277),volume_type_id=954d2648-ae9c-4def-98a7-fb4522790277)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30390cdc-cbb3-40d8-b3c3-6492015772d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30390cdc-cbb3-40d8-b3c3-6492015772d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f4be0d-d24a-4814-88b0-597b7e725a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f4be0d-d24a-4814-88b0-597b7e725a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0de479b8-b93c-4c24-bcd8-a8ac467f6018', 'volume_name': 'volume-0de479b8-b93c-4c24-bcd8-a8ac467f6018', 'volume_size': 1, 'snapshot_id': '0fab7c3a-860d-47ca-9948-515abb7a8a75'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6194f417-4624-4497-9157-d3b29ef36f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6194f417-4624-4497-9157-d3b29ef36f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06deae05-b4aa-4e6f-af4b-6377bceb0238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:04 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Volume 0de479b8-b93c-4c24-bcd8-a8ac467f6018: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0de479b8-b93c-4c24-bcd8-a8ac467f6018', 'volume_size': 1, 'snapshot_id': '0fab7c3a-860d-47ca-9948-515abb7a8a75'} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Acquiring lock "cinder-quobyte-0fab7c3a-860d-47ca-9948-515abb7a8a75-0de479b8-b93c-4c24-bcd8-a8ac467f6018" by "_create_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Lock "cinder-quobyte-0fab7c3a-860d-47ca-9948-515abb7a8a75-0de479b8-b93c-4c24-bcd8-a8ac467f6018" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Creating volume 0de479b8-b93c-4c24-bcd8-a8ac467f6018 from snapshot 0fab7c3a-860d-47ca-9948-515abb7a8a75 {{(pid=87084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Selected osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Acquiring lock "cinder-quobyte-0de479b8-b93c-4c24-bcd8-a8ac467f6018" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Lock "cinder-quobyte-0de479b8-b93c-4c24-bcd8-a8ac467f6018" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] snapshot: 0fab7c3a-860d-47ca-9948-515abb7a8a75, volume: 0de479b8-b93c-4c24-bcd8-a8ac467f6018, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf994e0f-7579-4c5d-9d21-110d8e5012e6]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:05 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75 Nov 02 11:01:05 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:05 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75" returned: 0 in 0.359s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9911db51-8ab6-4874-9b98-bcdced1186db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:01:05 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d5dc33-05ca-4232-8b31-f480ecffc6de]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:05 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db Nov 02 11:01:05 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:05 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db" returned: 0 in 0.350s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 11:01:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 11:01:05 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Path /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0de479b8-b93c-4c24-bcd8-a8ac467f6018 not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 11:01:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0de479b8-b93c-4c24-bcd8-a8ac467f6018 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:05 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0de479b8-b93c-4c24-bcd8-a8ac467f6018 Nov 02 11:01:05 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:11 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0de479b8-b93c-4c24-bcd8-a8ac467f6018" returned: 0 in 5.797s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:11 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Image conversion details: src /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0de479b8-b93c-4c24-bcd8-a8ac467f6018 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:01:11 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Converted 1024.00 MB image at 176.60 MB/s Nov 02 11:01:11 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0de479b8-b93c-4c24-bcd8-a8ac467f6018 is being set with open permissions: ugo+rw Nov 02 11:01:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0de479b8-b93c-4c24-bcd8-a8ac467f6018 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:11 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0de479b8-b93c-4c24-bcd8-a8ac467f6018 Nov 02 11:01:11 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:11 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0de479b8-b93c-4c24-bcd8-a8ac467f6018" returned: 0 in 0.227s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Lock "cinder-quobyte-0de479b8-b93c-4c24-bcd8-a8ac467f6018" released by "_copy_volume_from_snapshot" :: held 6.814s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Lock "cinder-quobyte-0fab7c3a-860d-47ca-9948-515abb7a8a75-0de479b8-b93c-4c24-bcd8-a8ac467f6018" released by "_create_volume_from_snapshot" :: held 6.873s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.890s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06deae05-b4aa-4e6f-af4b-6377bceb0238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0de479b8-b93c-4c24-bcd8-a8ac467f6018', 'volume_size': 1, 'snapshot_id': '0fab7c3a-860d-47ca-9948-515abb7a8a75'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ecd0b9-575b-4eb6-b6eb-9a68656e0826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:11 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Volume volume-0de479b8-b93c-4c24-bcd8-a8ac467f6018 (0de479b8-b93c-4c24-bcd8-a8ac467f6018): created successfully Nov 02 11:01:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ecd0b9-575b-4eb6-b6eb-9a68656e0826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Flow 'volume_create_manager' (accbdf4b-2ef1-4810-93b6-fec7a9af7100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:11 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4ce649d7-a75a-46c2-b295-35012a7c7a4e tempest-SnapshotDependencyTests-1889918259 None] Created volume successfully. Nov 02 11:01:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] Acquiring lock "cinder-0fab7c3a-860d-47ca-9948-515abb7a8a75-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] Lock "cinder-0fab7c3a-860d-47ca-9948-515abb7a8a75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] Acquiring lock "cinder-quobyte-9911db51-8ab6-4874-9b98-bcdced1186db" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] Lock "cinder-quobyte-9911db51-8ab6-4874-9b98-bcdced1186db" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] Acquiring lock "cinder-quobyte-0fab7c3a-860d-47ca-9948-515abb7a8a75" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] Lock "cinder-quobyte-0fab7c3a-860d-47ca-9948-515abb7a8a75" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] Deleting offline snapshot 0fab7c3a-860d-47ca-9948-515abb7a8a75 of volume 9911db51-8ab6-4874-9b98-bcdced1186db {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:01:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] snapshot_file for this snap is: volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:01:12 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca0b44d-80c1-406f-8664-1e348fb2ba7f]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:12 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75 Nov 02 11:01:12 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:12 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75" returned: 0 in 0.353s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9911db51-8ab6-4874-9b98-bcdced1186db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:01:12 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90ac6af-6e3f-4b8d-b0d1-cec9d4dcfa2b]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:12 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db Nov 02 11:01:12 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:13 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db" returned: 0 in 0.515s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:13 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75 Nov 02 11:01:13 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:13 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75" returned: 0 in 0.322s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:13 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75 Nov 02 11:01:13 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:13 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db.0fab7c3a-860d-47ca-9948-515abb7a8a75" returned: 0 in 0.236s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] Lock "cinder-quobyte-0fab7c3a-860d-47ca-9948-515abb7a8a75" released by "_delete_snapshot" :: held 1.523s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] Lock "cinder-quobyte-9911db51-8ab6-4874-9b98-bcdced1186db" released by "delete_snapshot" :: held 1.549s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:13 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] Created reservations ['118e7a06-6f64-4d1b-b475-a1e194d37a7a', '0389c16d-1aaa-4d39-860b-dbeefd38ae15', '75417ac5-25a0-4de0-9a4f-49e15a78616c', 'd616c88f-fca2-4b3d-b040-831e4a1b8bc6'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:01:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] Delete snapshot completed successfully. Nov 02 11:01:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8423aae8-3be3-4c03-ac30-51693112942e tempest-SnapshotDependencyTests-1889918259 None] Lock "cinder-0fab7c3a-860d-47ca-9948-515abb7a8a75-delete_snapshot" released by "delete_snapshot" :: held 1.671s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e76ec651-035d-4be8-ab6b-60ba30ee8d6f tempest-SnapshotDependencyTests-1889918259 None] Acquiring lock "cinder-9911db51-8ab6-4874-9b98-bcdced1186db-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e76ec651-035d-4be8-ab6b-60ba30ee8d6f tempest-SnapshotDependencyTests-1889918259 None] Lock "cinder-9911db51-8ab6-4874-9b98-bcdced1186db-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e76ec651-035d-4be8-ab6b-60ba30ee8d6f tempest-SnapshotDependencyTests-1889918259 None] Acquiring lock "cinder-quobyte-9911db51-8ab6-4874-9b98-bcdced1186db" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e76ec651-035d-4be8-ab6b-60ba30ee8d6f tempest-SnapshotDependencyTests-1889918259 None] Lock "cinder-quobyte-9911db51-8ab6-4874-9b98-bcdced1186db" acquired by "delete_volume" :: waited 0.013s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f16a38-0f81-4c9a-8a26-214f309af61d]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e76ec651-035d-4be8-ab6b-60ba30ee8d6f tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:14 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db Nov 02 11:01:14 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:14 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e76ec651-035d-4be8-ab6b-60ba30ee8d6f tempest-SnapshotDependencyTests-1889918259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db" returned: 0 in 0.351s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e76ec651-035d-4be8-ab6b-60ba30ee8d6f tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:14 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db Nov 02 11:01:14 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:15 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e76ec651-035d-4be8-ab6b-60ba30ee8d6f tempest-SnapshotDependencyTests-1889918259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-9911db51-8ab6-4874-9b98-bcdced1186db" returned: 0 in 0.235s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e76ec651-035d-4be8-ab6b-60ba30ee8d6f tempest-SnapshotDependencyTests-1889918259 None] Lock "cinder-quobyte-9911db51-8ab6-4874-9b98-bcdced1186db" released by "delete_volume" :: held 0.645s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:15 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-e76ec651-035d-4be8-ab6b-60ba30ee8d6f tempest-SnapshotDependencyTests-1889918259 None] Created reservations ['36d030cd-2d3f-496e-9bc5-679d8156d654', '8ce7ae06-4b6d-41db-9540-35afa7c917bc', '8c8805b6-9940-4ceb-b265-9a29259d13a8', '749d6723-3ea3-46f9-b5fd-cab63b5a167a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:01:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e76ec651-035d-4be8-ab6b-60ba30ee8d6f tempest-SnapshotDependencyTests-1889918259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e76ec651-035d-4be8-ab6b-60ba30ee8d6f tempest-SnapshotDependencyTests-1889918259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e76ec651-035d-4be8-ab6b-60ba30ee8d6f tempest-SnapshotDependencyTests-1889918259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e76ec651-035d-4be8-ab6b-60ba30ee8d6f tempest-SnapshotDependencyTests-1889918259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e76ec651-035d-4be8-ab6b-60ba30ee8d6f tempest-SnapshotDependencyTests-1889918259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e76ec651-035d-4be8-ab6b-60ba30ee8d6f tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:15 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 11:01:15 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:15 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e76ec651-035d-4be8-ab6b-60ba30ee8d6f tempest-SnapshotDependencyTests-1889918259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.236s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:15 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-e76ec651-035d-4be8-ab6b-60ba30ee8d6f tempest-SnapshotDependencyTests-1889918259 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:01:15 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e76ec651-035d-4be8-ab6b-60ba30ee8d6f tempest-SnapshotDependencyTests-1889918259 None] Deleted volume successfully. Nov 02 11:01:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e76ec651-035d-4be8-ab6b-60ba30ee8d6f tempest-SnapshotDependencyTests-1889918259 None] Lock "cinder-9911db51-8ab6-4874-9b98-bcdced1186db-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-625cd8f1-3876-4df2-b499-c859206ac094 tempest-SnapshotDependencyTests-1889918259 None] Acquiring lock "cinder-0de479b8-b93c-4c24-bcd8-a8ac467f6018-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-625cd8f1-3876-4df2-b499-c859206ac094 tempest-SnapshotDependencyTests-1889918259 None] Lock "cinder-0de479b8-b93c-4c24-bcd8-a8ac467f6018-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-625cd8f1-3876-4df2-b499-c859206ac094 tempest-SnapshotDependencyTests-1889918259 None] Acquiring lock "cinder-quobyte-0de479b8-b93c-4c24-bcd8-a8ac467f6018" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-625cd8f1-3876-4df2-b499-c859206ac094 tempest-SnapshotDependencyTests-1889918259 None] Lock "cinder-quobyte-0de479b8-b93c-4c24-bcd8-a8ac467f6018" acquired by "delete_volume" :: waited 0.013s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:15 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9015313-2d59-4562-8ea4-48074306e871]: (4, 'qcow2') {{(pid=88022) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-625cd8f1-3876-4df2-b499-c859206ac094 tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0de479b8-b93c-4c24-bcd8-a8ac467f6018 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:15 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0de479b8-b93c-4c24-bcd8-a8ac467f6018 Nov 02 11:01:15 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:16 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-625cd8f1-3876-4df2-b499-c859206ac094 tempest-SnapshotDependencyTests-1889918259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0de479b8-b93c-4c24-bcd8-a8ac467f6018" returned: 0 in 0.356s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-625cd8f1-3876-4df2-b499-c859206ac094 tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0de479b8-b93c-4c24-bcd8-a8ac467f6018 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:16 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0de479b8-b93c-4c24-bcd8-a8ac467f6018 Nov 02 11:01:16 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:16 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-625cd8f1-3876-4df2-b499-c859206ac094 tempest-SnapshotDependencyTests-1889918259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd/volume-0de479b8-b93c-4c24-bcd8-a8ac467f6018" returned: 0 in 0.246s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-625cd8f1-3876-4df2-b499-c859206ac094 tempest-SnapshotDependencyTests-1889918259 None] Lock "cinder-quobyte-0de479b8-b93c-4c24-bcd8-a8ac467f6018" released by "delete_volume" :: held 0.644s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:16 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-625cd8f1-3876-4df2-b499-c859206ac094 tempest-SnapshotDependencyTests-1889918259 None] Created reservations ['d9200d4f-0156-404b-aa5c-fe8bb2215344', 'b181689b-985a-4c61-84bb-839a48cce613', 'c9e8c505-52e9-431d-9b36-b9c5a22c5c98', '57695b09-3f40-4eb7-848b-1537ddce44af'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:01:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-625cd8f1-3876-4df2-b499-c859206ac094 tempest-SnapshotDependencyTests-1889918259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-625cd8f1-3876-4df2-b499-c859206ac094 tempest-SnapshotDependencyTests-1889918259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-625cd8f1-3876-4df2-b499-c859206ac094 tempest-SnapshotDependencyTests-1889918259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-625cd8f1-3876-4df2-b499-c859206ac094 tempest-SnapshotDependencyTests-1889918259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-625cd8f1-3876-4df2-b499-c859206ac094 tempest-SnapshotDependencyTests-1889918259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-625cd8f1-3876-4df2-b499-c859206ac094 tempest-SnapshotDependencyTests-1889918259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:16 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 11:01:16 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:16 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-625cd8f1-3876-4df2-b499-c859206ac094 tempest-SnapshotDependencyTests-1889918259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.241s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:16 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-625cd8f1-3876-4df2-b499-c859206ac094 tempest-SnapshotDependencyTests-1889918259 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:01:16 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-625cd8f1-3876-4df2-b499-c859206ac094 tempest-SnapshotDependencyTests-1889918259 None] Deleted volume successfully. Nov 02 11:01:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-625cd8f1-3876-4df2-b499-c859206ac094 tempest-SnapshotDependencyTests-1889918259 None] Lock "cinder-0de479b8-b93c-4c24-bcd8-a8ac467f6018-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:26 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=27,cinder:UPDATE=30,cinder:INSERT=7 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:01:26 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=28,cinder:INSERT=8,cinder:DELETE=5,cinder:SELECT=22 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:01:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:01:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-99a9844a-ec54-4929-a320-16c0096f6235'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:53 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd Nov 02 11:01:53 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:53 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a494b9ca5b4dafb240e9ef4c7b436efd" returned: 0 in 0.248s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:01:53 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:01:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:01:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c29fee71-8211-40b1-85a1-89f9bf2776fd None None] thread info: [<_MainThread(MainThread, started 127942921465984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}